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(54) Efficient and secure update of software and data 



(57) The invention concerns apparatus for updating 
a data file, from an earlier version to a later version. The 
invention compares the earlier version with a later ver- 
sion, and derives a transformation, which contains infor- 
mation as to the similarities and differences. The 
invention then processes the earlier version, using the 
transformation, in order to derive the later version, with- 
out reference to the later version itself. 



The invention allows multiple versions of an original 
file, such as bank records located at multiple locations, 
to be updated by transmitting the transformation to the 
multiple locations, instead of transmitting the updated 
files themselves. The procedure is highly resistant to 
interception of the updated data, because the transfor- 
mation, in general, does not contain the entire contents 
of the later versions. 
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Description 

An APPENDIX is attached which contains source code used by the invention. The invention concerns a method for 
remotely updating software or data, or both, which reduces the amount of data transmitted, and is less susceptible to 
5 interception. 

Background of The Invention 

Electronic data transmission between computers via a common-carrier telephone system requires speed and secu- 
10 rity. Transmission speed can be enhanced by compressing the data before transmission, while security can be protected 
using encryption. Data compression is also beneficial for encryption because it reduces redundancy in the data source, 
and increases resistance to cracking attempts. 

However, if a data file is compressed and encrypted, the resulting compressed-and-encrypted data is based on a 
single source. Data compression and encryption based on single data sources are not perfect. Unless great redundancy 
15 exists in the data, compression does not perform well, and high-speed computers working together with modern crypto- 
analytic methods can crack most encrypted data. 

In many situations, multiple later versions of an initial data source are frequently transmitted after slight changes in 
the data. The fact that the changes are slight means that all versions are inherently similar. The inherent similarity can 
be exploited to compute a minimal transformation that transforms one version into another. 
20 This process of computing such a transformation is called data differencing. Data differencing enhances transmis- 
sion speed because it reduces the amount of data to be communicated. It also enhances privacy because a snooper 
without the earlier version cannot deduce too much information from the transmitted data. 

A number of compression and differencing techniques have been previously considered. The article "A Universal 
Algorithm for Sequential Data Compression," by J. Ziv and A. Lempel, contained in IEEE Transactions on Information 
25 Theory, 23(3): pp. 337 - 343, May, 1977, describes a technique to compress a single data file. This works by analyzing 
a data sequence and, at each position, if possible, identifying the longest segment that matches another segment in the 
already analyzed part. Such a segment, if found, is encoded using the matching position and the length of the match. 
Unmatched data are output as-is. 

An implementation of this algorithm was the subject of U.S. Patent number 4,464,650, August 7, 1984, by W.L. 
so Eastman, A. Lempel, and J. Ziv. The Eastman-Lempel-Ziv compression method is slow on de-compression because it 
has to do roughly the same amount of work during de-compression as during compression. It also does not apply to 
data differencing. 

On UNIX systems, differences between text (not binary) files can be computed using the program "diff," which 
produces a set of lines that must be deleted or added to transform the first file to the second. The "diff" approach can 

35 produce very large transformations because small changes in text lines cause them to be considered different. Further, 
it only works on text files, so it has a limited range of applicability. 

The article "The String-to-String Correction Problem with Block Moves," by Walter F. Tichy, contained in ACM Trans- 
actions on Computer Systems, 2(4) : pp. 309 - 321 , November, 1 984, describes an algorithm to compute a set of instruc- 
tions called block-moves to transform one version of a data file to another. A block-move is a data segment in the second 

40 version that matches another segment in the first version. This algorithm is essentially unrealized and does not take 
advantage of any redundancy inherent in the second version to minimize the transformation needed to construct the 
second version from the first version. 

Summary of The Invention 

45 

In one form of the invention, a computer program compares af irst and a second, later, version of a file, and produces 
a sequence of instructions. The instructions allow replication of the second version, based on the first version. 

The instructions are of two types: One type is a COPY instruction, which orders copying of a specified sequence of 
characters into a file being constructed. The specified sequence can reside either in the first version, or in the file under 
so construction. 

The second type is an ADD instruction, which orders addition of a sequence of characters, which accompanies the 
ADD instruction. When the instructions are executed in sequence, they produce a concatenation of sequences, which 
are COPIED and ADDED, producing a replica of the second version. 

55 Brief Description of The Drawings 

Figure 1 is a schematic of how the invention is used for data communication between computers. 
Figures 1 A through 1 1 explain, by analogy, principles used by the invention. 
Figure 1J illustrates a security aspect of the invention. 



2 



EP 0 717 353 A2 



Figure 2 gives an example of two versions of a data set and a set of instructions to transform one of the versions to 
the other. 

Figures 2A through 2E illustrate operation of the procedure described in Figure 3. 

Figures 2F through 2H illustrate operation of the procedure described in Figure 5. 
5 Figure 3 describes the decoding procedure in a pseudo-C language. 

Figure 4 shows the actual encoding of the instructions of Figure 2. 

Figure 5 describes the encoding procedure. 

Figure 6 describes the INSERT procedure used in Figure 5. 

Figure 7 describes the SEARCH procedure used in Figure 5. 
10 Figure 8 describes the EXTEND procedure used in Figure 5. 

Figure 9 shows the inserted positions of the example VERSION1 and VERSION2 data of Figure 2. 

Figure 10 shows the secure version of the coded instructions of Figure 4. 

Detailed Description of The Invention 

15 

A simplified analogy will explain some of the more fundamental aspects of the invention. A technical explanation of 
computer code which implements part of the invention is given later, beginning in the section entitled "The Invention". 

Analogy 

20 

Assume that a newspaper reporter and a newspaper editor are writing an article together, but at different locations. 
Assume that they both have written VERSION 1, which is shown in Figure 1A. Assume that the reporter has made the 
changes shown in Figure 1 B, resulting in VERSION 2, which is shown in Figure 1C (the boxes indicate the locations of 
changes), and wishes to send this version to the editor. The following procedure will allow the reporter to send VERSION 
25 2 to the editor, but without sending the entire contents of VERSION 2. 

Procedure 

First, the reporter assigns a position to each word in VERSION 1 , as indicated in Figure 1 A. There are 50 positions, 
30 corresponding to the 50 words. 

Second, the reporter ascertains the vocabulary of VERSION 1 . The vocabulary is a list, or table, of the words used, 
as indicated in Figure 1 A. Note that each word appears in the vocabulary only once. For example, the word "them" at 
position 18 is not entered into the vocabulary, because this word previously appeared, at position 16. 

In order to assure that each word appears only once, the reporter, as each word is entered, checks to see whether 
35 that word already exists in the table. For example, the reporter enters the first word, "when." Then, the reporter takes 
the word at position 2, "buying," and checks it against the first word in the vocabulary, namely, "when". There is no match, 
so the reporter enters "buying" into position 2 in the vocabulary. 

The reporter proceeds in this manner until the word "them" is reached at position 18. When checking this word 
against the previous 17 entries in the vocabulary, the reporter finds that "them" matches "them" at position 16 in the 
40 vocabulary. Consequently, the latter "them" is not entered into the vocabulary, because it would duplicate the previous 
"them." 

When the last word in VERSION 1 is checked for matches, the vocabulary becomes complete. VERSION 1 , which 
is 50 words in overall length, contains only 38 different words, as indicated by the length of the vocabulary. 

Next, the reporter establishes a vocabulary for VERSION 2, as shown in Figure 1C. VERSION 2 has the same 
45 vocabulary as VERSION 1 , with the exception of three additional words, indicated as NEW WORDS. Now the reporter 
is ready to transmit VERSION 2 to the editor. 

The reporter transmits VERSION 2 by transmitting the following six messages, or instructions, each of which will 
be explained by a respective Figure in Figures 1 D - 1 1: 

so 1. COPY 2 1 

2. ADD 1 Hawaiian 

3. COPY 3 3 

4. ADD 1 all 

5. COPY 37 8 
55 6. ADD 2 a brick. 
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Instruction 1 

By pre-arrangement, the reporter and the editor set a POINTER at position 1, as indicated in Figure 1D. The first 
instruction, "COPY 2 1" means "COPY the sequence of 2 words which begin at position 1 in VERSION 1." (In each 
5 instruction, it is implicit that the words are placed at the POINTER in VERSION 2.) This operation is shown in Figure 1 D. 
Note that the syntax is 

COPY [number of words, starting position in VERSION 1]. 
After following the instruction, the editor moves the POINTER by the "number of words" in the COPY instruction, 
which, in this case, is 2. The POINTER is now located as shown in Figure 1E. 

10 

Instruction 2 

Instruction 2 states "ADD 1 Hawaiian," which means "ADD the one word 'Hawaiian'." This operation is shown in 
Figure 1 E. Note that the syntax is 
15 ADD [number of words, words themselves]. 

After following the instruction, the editor moves the POINTER by the "number of words" in the ADD instruction, 
which, in this case, is 1. The POINTER is now located as shown in Figure 1 F. 

Instruction 3 

The third instruction, "COPY 3 3" means "COPY the sequence of 3 words which begin at position 3 in VERSION 
1 ." This operation is shown in Figure 1 F. Note that the syntax is identical to that of instruction 1 . 

After following the instruction, the editor moves the POINTER by the "number of words" in the copy instruction, 
which, in this case, is 3. The POINTER is now located as shown in Figure 1G. 

Instruction 4 

Instruction 4 states "ADD 1 all," which means "ADD the one word 'all'." This operation is shown in Figure 1G. 
After following the instruction, the editor moves the POINTER by the "number of words" in the ADD instruction, 
30 which, in this case, is 1 . The POINTER is now located as shown in Figure 1 H. 

Instruction 5 

The fifth instruction, "COPY 37 8" means "COPY the sequence of 37 words which begin at position 8 in VERSION 
35 1 ." This operation is shown in Figure 1 H. Note that the syntax is identical to that of instruction 1 . 

After following the instruction, the editor moves the POINTER by the "number of words" in the copy instruction, 
which, in this case, is 37. The POINTER is now located as shown in Figure 1 1. 

Instruction 6 

40 

Instruction 4 states "ADD 2 a brick," which means "ADD the 2 words f a brick 1 ." This operation is shown in Figure 1 1. 
Now VERSION 2 has been constructed. 

Significant Features 

45 

VERSION 2, shown in Figure 1C, contained 43 words, which themselves contained 163 characters. However, the 
set of six instructions contained 27 characters, plus the instructions themselves (ie, COPY and ADD). If each instruction 
and each character is encoded as one byte, then the total message equals 27 + 6 characters, or 33 characters. Trans- 
mitting 33 characters takes a significantly shorter time than transmitting 163 characters. 

50 

The Invention 

The previous analogy was a simplification, and does not illustrate all of the features of the invention. Figure 2 illus- 
trates two VERSIONS of a file, together with a TRANSFORMATION, which allows construction of VERSION2 from the 
55 combination of VERSION1 and the TRANSFORMATION itself. The procedure shown in Figure 3 accomplishes the 
reconstruction, and will now be explained. First, the general pattern will be elaborated. 

As background, four important points should be recognized. One, each character in each VERSION occupies a 
numbered position, as shown in Figure 2A. For example, in VERSION 1 , the first "a" occupies position 0. The first "b" 
occupies position 1, and so on. 
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Two, the numbered positions in VERSION 2 begin after the highest-numbered position in VERSION 1. Thus, since 
the highest position in VERSION 1 is "15," VERSION 2 begins with "16." 

Three, a pointer (which is a variable in the procedure of Figure 3) indicates a current position, as indicated in Figure 

2A. 

5 Four, the TRANSFORMATION contains instructions. There are two types of instruction, namely, ADD and COPY. 

The operation of these two instructions will be explained by showing how VERSION 2 is constructed from VERSION 1 . 

Instruction 1 

10 In Figure 2B, instruction 1 of the TRANSFORMATION is executed. This instruction, "COPY 4 0," states, in effect, 
" COPY the FOUR characters beginning at position ZERO in VERSION 1 to the pointer in VERSION 2." (The underlined 
words refer to the words in the instruction: FOUR refers to 4, and so on.) Figure 2B illustrates the operation. 

It is significant that; in this instruction, the characters used to generate VERSION 2 are obtained from VERSION 
1 , not from the instruction itself. Thus, if the instruction were obtained via a telephone transmission, an eavesdropper 
15 would obtain no information usable in constructing VERSION 2 because the eavesdropper is presumed to have no 
access to VERSION 1. 
The syntax is 
COPY [number of characters, starting position] 

20 Instruction 2 

In Figure 2C, instruction 2 is executed. This instruction, "ADD 2 x,y," states, in effect, " ADD the TWO characters x 
and y to VERSION 2, beginning at the pointer." 

It is significant that, in this instruction, the characters used to generate VERSION 2 are obtained from the instruction 
25 itself. Consequently, an eavesdropper does obtain some information about VERSION 2. However, in practice, this type 
of instruction is expected to be intermixed with so many types of COPY instructions (which contain no information) that 
the eavesdropper would obtain no significant information about VERSION 2. 

Nevertheless, it is possible, in theory, that the TRANSFORMATION may contain ADD instructions exclusively, in 
which case the eavesdropper would obtain VERSION 2 in its entirety. Or the number of ADD instructions may be very 
30 large. To prevent an eavesdropper from obtaining information from these ADD instructions, an encryption option is pro- 
vided, which is discussed later. 

The syntax is of the ADD instruction is 
ADD [number of characters, characters themselves] 

35 Instruction 3 

In Figure 2D, instruction 3 is executed. This instruction, "COPY 6 20", in effect, states: 
generate a COPY, which is six characters long, using the characters residing between position TWENTY and the 
pointer, and place them at the pointer. 
40 The result is the sequence xyxyxy, as indicated. 

(As another example, if the COPY statement read "COPY 6 19", then it, in effect, would have stated 
generate a COPY, which is sjx characters long, using the characters residing between position NINETEEN (not 
TWENTY) and the pointer, and place them at the pointer. 

The sequence added at the pointer would have been dxydxy, because the sequence residing between position 
45 nineteen and the pointer is dxy.) 

It is significant that, in this instruction, the characters used to generate VERSION 2 are obtained from VERSION 2 
itself. Thus, it is now seen that the COPY instruction uses two sources, depending on the address specified. In this 
instruction, the address (ie, the "20" in "COPY 6 20") indicates VERSION 2 (ie, the address is greater than 1 5). VERSION 
2 is the source for this command. 
so In contrast, if the address were 15 or less, then VERSION 1 would have been used as the source. 

This approach, in effect, allows one to expand the vocabulary, using ADD instructions. Then, when VERSION 2 is 
found to contain characters which are (a) not in VERSION 1 , but (b) contained in the expanded vocabulary (because 
added earlier), a COPY instruction can be used. The COPY instruction has two benefits. 

One is that a COPY instruction can insert a large number of characters, merely by indicating their total number, and 
55 starting position. In contrast, the ADD instruction requires the characters themselves to be transmitted, which entails a 
longer transmission. 

A second is that, as discussed above, the COPY instruction contains no information, unless an interceptor of the 
instruction also happens to possess VERSION 1. 
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Instruction 4 

In Figure 2E, instruction 4 is executed. This instruction, "COPY 5 9," in effect, states: " COPY the FIVE characters 
beginning at position NINE in VERSION 1 ." This instruction resembles instruction 1 . 

5 

Reference to Process of Figure 3 

Figure 3 illustrates a process by which a computer can construct VERSION 2 from the combination of VERSION 1 
and the TRANSFORMATION. 

10 In Figure 3, line 2 initializes a variable c, which is used to compute the pointer shown in Figures 2B - 2E. The pointer 
is computed in lines 9, 13, and 14, as appropriate. 

Instruction 1 

is Instruction 1 (COPY 4 0) of the TRANSFORMATION shown in Figure 2 is executed in line 13 in Figure 3. The 
variable "p" indicates the starting position of the source data, is obtained from the instruction, and equals 0. Since "p" 
is less than "n" (line 12), the source lies in VERSION 1 . Consequently, line 13 is executed, because of the IF-statement, 
and the data is copied from VERSION 1, beginning at position VERSION1+p, which is position 0. The variable "s" 
indicates the number of characters, is obtained from the instruction in line 7, and equals 4. 

20 The pointer is updated on line 16. 

Instruction 2 

Instruction 2 (ADD 2 x,y) is executed on line 9, because of the IF-statement on line 8. It places a sequence of 
25 characters, which is of length "s" (which equals 2) at the location VERSION2 + c. The pointer is updated on line 16. 

Instruction 3 

Instruction 3 (COPY 6 20) is executed on line 14, because of line 12: "p" (obtained from the instruction, and which 
30 equals 20) is less than "n." The copy function uses VERSION2 as the source, beginning at VERSION2 + c. The copy 
function takes a sequence which is s characters long. (The variable "s" is obtained from pointer-minus-20. The "20" is 
obtained from the instruction.) 

Instruction 4 

35 

Instruction 4 is executed on line 13, like instruction 1 . 

Generation of TRANSFORMATION 

40 Figure 5 contains a procedure which examines each VERSION, character-by-character, and generates the set of 
instructions which allows construction of VERSION 2 from the combination of VERSION 1 and the instructions, which 
are called a transformation. The transformation of Figure 2 was discussed above. The general approach taken by this 
procedure is the following. 

45 Run 1 

VERSION 1 is processed first. VERSION 1 is shown at several locations in Figure 2F The code of Figure 5 asks 
whether the four-character sequence beginning at position 0 matches a four character sequence beginning at a previous 
position. Of course, since nothing exists prior to position 0, the answer is No. Thus, position 0 is flagged with a carat, as 
so indicated in the row labeled RUN 1 . 

Run 2 

On the second run, the code asks a similar question, namely, whether the four-character sequence beginning at 
55 position 1 matches a four-character sequence beginning at a previous position. The answer is No, and a flag is placed 
at position 1. 
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Runs 3 and 4 

In a similar way, flags are placed at positions 2 and 3, resulting in the flagging shown at RUN 4 in Figure 2F. 
5 Run5 

Run 5 produces different results. In RUN 5, the code asks the usual question, Does the four-character sequence 
beginning at position 4 match a four-character sequence beginning at a previous position ? The answer is Yes, at position 
0, as indicated in the row labeled RUN 5. Position 4 is not flagged, and the EXTEND function (line 16, Figure 5) is called 
10 into action. 

The EXTEND function asks how long the match extends. It asks whether the next position after the matched block 
(the matched block occupies positions 4 - 7, so the next is position 8) has a match located four positions earlier. The 
answer is Yes, as indicated in trial TA. 

It then asks whether the second position after the matched block, position 9, has a match located four positions 
15 earlier. The answer is again Yes, as indicated by trial TB. This inquiry continues until a position is reached, in trial TE, 
where no such match is found. 

The EXTEND function has thus ascertained that the match extends for eight positions, from position 4 through 
position 1 1 . Because of the logic of the code, the last three positions of the extended match are flagged, namely, the 
"BCD" located in "RUN 5 RESULT" 

20 

Run 6 

Run 6 asks whether the four-character sequence beginning at position 12 (ie, the rightmost "e") matches any four- 
character sequence beginning at a position occurring previously. The answer is No, and a flag is placed at position 12, 
25 as indicated in the row labeled RUN 6. 

Results 

The results are shown at the bottom of Figure 2F, and labeled RESULT. Two important features are the following: 
30 One, as will be later explained, the flags indicate not only the beginnings, but also the endings, of possible 

sequences which are used to construct VERSION 2. 

Two, there are regions which are not flagged, as indicated. A search for sequence to use in constructing VERSION 
2 never begins in these regions, although the search can begin outside these regions, and then invade the region. Thus, 
since initial search points are eliminated, the overall searching time is reduced. 

35 

Processing off VERSION 2 
First Four Runs 

40 VERSION 2, the updated version, is processed next. The code asks whether the four-character sequences beginning 
at positions 1 6, 1 7, 1 8, and 1 9, shown in Figure 2G, have matches which begin at previous positions. The four-character 
sequence beginning at position 16 matches with that beginning at 0, but the latter three do not, so positions 1 7, 1 8, and 
19 are flagged, as indicated at the top of Figure 2G. 

The EXTEND function finds no extended match. The code of Figure 5 jumps to line 29, where it issues the "COPY 
45 4 0" instruction, which was explained above, and appears in Figure 2. 

The overall results are indicated by the arrow labeled OUTPUT. Three characters have been flagged, and a COPY 
instruction has been issued. It is important to note that these flagged characters are later treated as search initialization 
points, just as are the flagged characters in VERSION 1 . 

so Run 5 

The code of Figure 5 asks whether the four-character sequence "xyxy", beginning at position 20 (which resides in 
VERSION 2, shown in Figure 2G, in the section labeled RUN 5), has a match which begins at a previous position. The 
code searches, starting at each flag, including those now existing in VERSION 2. 
55 Further, at each flag, the code searches both forward and backward. (This forward-backward searching was not 
mentioned previously, for simplicity.) The overall searching is indicated by RUN 5 in Figure 2G. Because the searching 
(a) starts with each flag and (b) searches for four characters, both forward and backward, every four-character sequence 
of trial T1 through T1 2 is examined. In addition, similar searching is done, starting with thef lagged positions in VERSION 
2, namely, positions 17, 18, 19, and 20. 
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No match is found, so the V at position 20 is flagged. 
Run 6 

5 The code of Figure 5 asks whether the four-character sequence "yxyx", beginning at position 21 (which resides in 

VERSION 2), has a match which begins at a previous position. As for position 20, the code searches, forward and 
backward, beginning at each flag, including those in VERSION 2. No match is found, so position 21 is flagged. The 
current flagging is indicated at the upper right part of Figure 2H. 

10 Run 7 

The code of Figure 5 asks whether the four-character sequence "xyxy", beginning at position 22 (which resides in 
VERSION 2), has a match which begins at a previous position. The answer is Yes, at position 20. Thus, position 22 is 
not flagged, as indicated in Figure 2H, and the EXTEND function (line 16 of Figure 5) is entered. 
15 The EXTEND function determines, in the manner described in connection with Figure 2F, that the match extends 
through position 27 in Figure 2H. Consequently, the last three positions of the extended match are flagged, resulting in 
the flagging shown in the box at the lower left of the Figure. 

At this time, the logic proceeds to line 29 of Figure 5, wherein the two instructions "ADD 2 x,y" and "COPY 6 20" 
are issued. (The arguments "add" and "c" in line 29 refer to the ADD instruction. The arguments "pos" and "len" refer to 
20 the COPY instruction.) 

Run 8 

The code asks whether the sequence "bcde", beginning at position 28 (See OUTPUT box in Figure 21), has a match 
25 beginning at a previous position. The answer is Yes, at position 9 in VERSION 1 (see Figure 2G, upper left). Now the 
EXTEND function is called, which determines that the match extends to an additional character, the T. 

The code, at line 29, then issues the instruction "COPY 5 9". The four instructions of Figure 2 have been generated. 
VERSION 2 can now be reconstructed from VERSION 1 , plus the instructions. 

30 Characterization 

The preceding overview illustrates the following principles: 
ONE, once it is determined that a position represents a previously matched sequence, that position is not flagged, 
and consequently, subsequent searches are not initiated at that position, because such initiation would be redundant. 
35 Thus, a reduced set of searching positions is obtained (if possible). 

TWO, VERSION 2 is constructed from two types of sources, namely, (a) sequences copied from either VERSION 
1 or VERSION 2 and (b) sequences ADDED to VERSION 2. Further, the ADDED sequences can be used later, in 
copying operations. 

From another point of view, if a first user possesses VERSION 1 , and if a second user possesses both VERSION 
40 1 and VERSION 2, the first user can construct a replica of VERSION 2, if the second user identifies the following 
sequences of characters: 

(a) those to be copied from the first user's VERSION 1 , (b) those to be added to first user's VERSION 1 , and 
(c) those to be copied from the first user's replica of VERSION 2. 

45 

THREE, each flagged position represents the starting point of a possible vocabulary word. Analogous words are 
shown iri Figure 1 A. However, unlike the vocabulary of Figure 1 A, the vocabulary of each flagged position represents 
numerous possible sequences. 

For example, assume VERSION 1 is the following: 
so abcdeFghijk. 

If the upper-case F (position 6) is flagged, then it can represent the following sequences: 

f fg fgh fghi fghij fghijk. 
These sequences can contain other flagged positions. 

Therefore, a single flagged position can represent multiple sequences for copying into VERSION 2. Thus, thisf lagged 
55 position can appear in multiple COPY instructions. For instance, "COPY 3 6" means COPY "fgh." "COPY 5" means 
COPY "fghij". 
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Security Aspects 

As mentioned above, the ADD instructions contain information as to the content of VERSION 2, and this information 
may need security protection. One approach to security is shown in Figure 1 J. 
5 The ADD instruction of Figure 2 ("ADD 2 x,y"), which is sent, is modified to contain a pointer to a location within 

VERSION 1. This modified instruction is labeled INSTRUCTION SENT in Figure 1 J. This pointer is "2", which indicates 
the "c". 

The information sent (ie, the bytes representing "x" and "y") is then EX-ORed with the data beginning with the "c". 
Figure 1 J, left side, indicates the EX-OR operation. The instruction sent is "ADD 2 2" plus the result of the EX-OR 
io operation. This EX-OR result contains no information of value to an eavesdropper, because the eavesdropper has no 
access to VERSION 1. 

The data contained in the received instruction, indicated on the right side of Figure 1 K, is EX-ORed with the same 
data in VERSION 1 , namely, that which begins with the "c". This EX-ORing recovers the original data, namely "x.y". 
This procedure exploits a property of the EX-OR operation, namely, that EX-ORing a first word with a second word 
15 produces a third word. ED-ORing the third word with the second recovers the first. 
Thus, from the transmitted instruction, which is 
ADD 2 2 [EX-OR result], 
one obtains 

ADD 2 x,y, 
20 which is the intended instruction. 

Important Considerations 

1. The order in which the COPY and ADD instructions occur is, of course, important. If they are scrambled as to 
25 order, a different VERSION 2 will be obtained. 

From another perspective, the sequence itself is a type of information. The sequence can be viewed as a per- 
mutation of the instructions. The permutation contains information, just as permutations of the English alphabet 
create words, which convey information. 

Of course, the instructions could be transmitted in a scrambled order, if information is included which allows 
30 reconstruction of the sequence. For example, each instruction could be numbered. 

Irrespective of how execution of the proper sequence of instructions is attained, the execution produces a replica 
of VERSION 2, by a concatenation process. That is, returning to the example of Figures 2B through 2E: 

1 . First "abed" is written into the replica (Figure 2B). "abed" is taken from VERSION 1 . 
35 2. Then "xy" is concatenated (Figure 2C). "xy" is obtained from VERSION 1 . 

3. Then "xyxyxy" is concatenated (Figure 2D), "xyxyxy" is obtained from VERSION 2. (Alternately, four pairs of 
"xy" could have been taken from VERSION 1 and concatenated in step 2. This would be less efficient, however.) 

4. Then "bedef" is concatenated (Figure 2E). "bedef " is obtained from VERSION 1. 

40 2. Further regarding Consideration Number 1 , above, the Inventors point out that each COPY and ADD instruction 
contains the length of the passage to be COPIED or ADDED. Thus, for any given COPY or ADD instruction, the 
address within VERSION 2 where the COPYING or ADDING occurs can be readily computed, based on the total 
preceding lengths. (The code of Figure 3 illustrates this, because the pointer is computed based on these lengths.) 

45 3. The invention can be used to update any type of data file. It is not limited to text files, or to files of other specific 
types. It can handle binary files generally. 

Files contain characters. Each character is commonly represented by a byte of data. Since a byte contains eight 
bits, 28, or 256, possible characters can be represented by one byte. 

In "text" files, all of these possible combinations are not used. Only those representing alphanumeric^, and 
so some punctuation, are used. 

In "binary" files, all possible 256 combinations are used. The invention can handle binary files. In contrast, 
differencing programs of the prior art can handle only text files. 

4. The invention is not limited to remote replication of VERSION 2 from a stored VERSION 1. In addition, a later 
55 version of a program can be stored at a single location, by using the ADD and COPY instructions, rather than storing 
the version in its entirety. This approach will save storage space. When a version is desired to be reconstructed, 
the program of Figure 3 is executed. 
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5. It is not necessary that the version of a file which is reconstructed be the actual, chronologically later version of 
an earlier file. For example, VERSION 1 can be reconstructed from VERSION 2. 

Technical Discussion 

5 

A more technical discussion of the code given in Figures 3 and 5 will now be given. 
Overview 

10 A data file can be considered as a sequence of bytes. On virtually all current computers, a byte is the smallest 
natural unit that can be compressed efficiently in terms of storage, communication, and in-memory data manipulation. 
Though the term "data file" often refers to a file when stored on-disk, the present invention also allows such a sequence 
of bytes to be some segment of main memory. 

Figure 1 shows an example of using the present invention to keep data in synchronization between two computers. 

15 First, on the source computer, the two versions of the data, VERSION1 and VERSION2, are compared to produce a 
transformation that takes VERSION1 to VERSION2. This transformation is transmitted via some communications chan- 
nel to the target computer. Then, on the target computer, the transformation and the local copy of VERSION1 are used 
to reconstruct VERSION2. 

20 Coding and Decoding Transformation Instructions 

The transformation computed by the present invention consists of a sequence of two types of instructions, COPY 
and ADD. During the reconstruction of VERSION2, the COPY instruction defines the position and length of some existing 
segment of data to be copied while the ADD instruction defines a segment of data to be added. Figure 2 shows an 

25 example of two data files in which VERSION1 consists of the sequence of bytes "abc dab cda bed efgh" (spaces are 
added here for readability). VERSION2 consists of the sequence "abc dxy xyx yxy bedef." Thus, VERSION1 has length 
16, and VERSION2 has length 17. The transform shown in Figure 2 shows the instructions needed to reconstruct 
VERSION2 from VERSION1. Note that we use the convention that positions in VERSION1 are coded starting from 0, 
while positions in VERSION2 are coded starting from the length of VERSION1 . For example, the third instruction of the 

30 transform in Figure 2 is a COPY instruction that copies 6 bytes starting from position 4 of VERSION2, which is coded 
as 20. 

Figure 3 shows the procedure of how the reconstruction of a version is carried out in general. Line 1 initializes the 
variable "n" to the length of VERSION1. Line 2 sets the current position "c" in VERSION2 to zero. Line 3 starts a loop 
that is terminated on line 6 after the end-of-f ile condition is detected in line 5. Line 4 calls the function readinstO to read 
35 an instruction. Line 7 reads the copying size or the data size using the function readsizeO. Lines 8 and 9 check to see 
if the instruction is an ADD instruction and, if so, reads the data into VERSION2 starting at the current position c. Lines 
10 to 15 process a COPY instruction by reading in the position code, then performing the copy operation either from 
VERS ION 1 or VERSION2, as appropriate. Line 16 increases the current copy position in VERSION2 by the length of 
the newly reconstructed data. The copyO function is a simple function to copy data from one area of disk memory (or 
40 main memory) to another. However, the readinst(), readsizeO, readposO, and readdataO functions must be defined, 
based on some concrete definitions of how the COPY and ADD instructions and their parameters are encoded. 

Applying the procedure of Figure 3 to the example of Figure 1, we see that there are four steps in the decoding. 
The first step copies four bytes "abed" from VERSION1 , starting at position 0. THe second step adds 2 data bytes "xy". 
The third step copies from VERSION2 6 bytes starting at its position 4 (counting from 0 and coded as 20 by our con- 
45 vention). Note that at the start of this step, only the first 6 bytes "abedxy" of VERSION2 have been reconstructed as only 
the two bytes "xy" are available to copy. However, since data is copied from left to right, whenever a byte is to be copied 
it will have been constructed. The fourth and final step copies the 5 bytes "bedef " from position 9 of VERSION1 . 

We now give a description of the encoding of COPY and ADD instructions. This particular embodiment of these 
instructions are chosen since in the Inventors' experimentation they perform well for many different types of data. Given 
so the description, the readinstO, readsizeO, and readposO functions above can be straightforwardly implemented. Each 
instruction is coded starting with a control byte. The eight bits of a control byte are divided into two parts. The first four 
bits represent numbers from 0 to 1 5, each of which defines a type of instruction and a coding of some auxiliary information. 
Below is an enumeration of the first 1 0 values of the first four bits: 
0: an ADD instruction 
55 1 ,2,3: a COPY instruction with position in the QUICK cache; 

4: a COPY instruction with position coded as SELF; 
5: a COPY instruction with position coded as difference from HERE; 
6,7,8,9: a COPY instruction with position coded from a RECENT cache. 
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The QUICK cache is an array of size 768 (3 x 256). Each index of this array contains the value p of the position of 
a recent COPY instruction such that p modulo 768 is the array index. This cache is updated after each COPY instruction 
is output (during coding) or processed (during decoding). A COPY instruction of type 1, 2, or 3 will be immediately 
followed by a byte whose value is from 0 to 255 that must be added to 0, 256, or 51 2, respectively, to compute the array 
5 index where the actual position is stored. 

A COPY instruction of type 4 has the copying position coded as a sequence of bytes. 

A COPY instruction of type 5 has the difference between the copying position and the current position coded as a 
sequence of bytes. 

The RECENT cache is an array having 4 indices, and stores the most recent 4 copying positions. Whenever a COPY 
10 instruction is output (during coding) or processed (during decoding), its copying position replaces the oldest position in 
the cache. A COPY instruction of type 6 (respectively 7, 8, 9) corresponds to cache index 1 (respectively 2, 3, and 4). 
Its copying position is guaranteed to be larger than the position stored in the corresponding cache index and only the 
difference is coded. 

For the ADD instruction and COPY instruction of type from 1 through 9, the second 4 bits of the control byte, if not 
w zero, code the size of the data involved . If these bits are 0 , the respective size is coded as a subsequent sequence of bytes. 
It is a result of the encoding method that an AD D instruction is never followed by another ADD instruction. Frequently, 
an ADD instruction has data size less than or equal to 4, and the following COPY instruction is also small. In such cases, 
it is advantageous to merge the two instructions into a single control byte. The values from 10 to 15 of the first 4 bits 
code such merged pairs of instructions. In such a case, the first 2 bits of the second 4 bits in the control byte code the 
20 size of the ADD instruction and the remaining 2 bits code the size of the COPY instruction. Below is an enumeration of 
the values from 10 to 15 of the first 4 bits: 

10: a merged ADD/COPY instruction with copy position coded as SELF, 
1 1 : a merged ADD/COPY instruction with copy position coded as difference from HERE; 
12,13,14,15: a merge ADD/COPY instruction with copy position coded from a RECENT cache. 
25 Figure 4 shows an encoding of the four instructions of the transform shown in Figure 2. For each instruction, all 
eight bits of the control byte are shown. For example, the first four bits of the second control byte are zero, showing that 
the byte codes an ADD instruction. The second four bits of the same byte show that the size of the ADD instruction is 
2. The two data bytes "xy" come after the control byte. All three COPY instructions are coded using the SELF type, 
meaning that their copying positions are coded in bytes (with shown values) following the control bytes. The size param- 
30 eters of all the instructions are small enough so that they can all be encoded inside the control bytes. This small example 
shows that VERSION2 which is 17 bytes long can be coded in a transformation using only 9 bytes. 

Fast Computation of Matched Segments 

35 Figure 5 shows the method to partition VE RSION2 into segments and encode them as COPY and ADD instructions. 
Note that, for this encoding method, matches of short lengths are not useful because they take up at least as much 
space to encode as the data that they match. So the matching method can be tuned to ignore short matches. The 
minimum match length that we use is 4 and represented by the variable MIN in the body of the encoding procedure. 
Line 1 of Figure 5 initializes a search table T to empty. For efficiency, T is kept as a hash table with chaining for 

40 collisions. This data structure is standard, and is described in any data structure and algorithm textbook, such as pages 
111 - 112 in "The Design and Analysis of Computer Algorithms" by A. Aho, J. Hopcroft, and J. Ullman, published by 
Addison-Wesley, 1974. 

Table T contains certain selected positions in the two versions. These positions are inserted with the procedure 
insertO and used in the procedures searchO and extendO for last searching of longest matched data segments. Lines 

45 2 and 3 call the procedure processQ to select positions from VE RSION 1 and VE RSION2 to insert into the table T. COPY 
and ADD instructions are also generated during the processing of VERSION2. 

Lines 4 to 45 define the procedure processO- Lines 5 and 6 initialize the variables "n" and "m" to the length of 
VERSION1 and the version being processed. Line 7 initializes the curent position "c" of the version being processed to 
0. Line 8 initializes the start of data for an ADD instruction to -1 (ie, none). Lines 9 and 10 initialize the position and 

so length of the longest match for the data segment starting at position c Lines 1 1 to 42 define the main loop that process 
the given version. Lines 1 2 to 1 8 compute a longest, already-processed data segment that matches with the data seg- 
ment starting at c. The procedure searchO called on line 12 finds a match of length len+1. This procedure uses MIN 
bytes starting at position c+!en-(M I N-1 ) as a key to search for a matching position in the table T. Then it matches backward 
the data in "seq" and the data in the appropriate version to see if the match covers everything from c to c+len+1 . 

55 If such a match is found, the procedure extendO called on line 16 extends the match as far forward as possible. 
Lines 14 and 15 correspond to the case when there is no match and we break out of the search loop. Otherwise, the 
loop is repeated to find a longer match. Lines 19 and 26 insert the current unmatched position c into the table T. 
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Note that the actual value to be inserted is c if seq is VERSION1 ; otherwise, it is c plus the length of VERSION1 
(which is the convention for encoding positions in VERSION2 that we described earlier). The procedure insert(T,seq,p,ori- 
gin) inserts the coded position p+origin into table T using as its key. MIN bytes starting from position p in version seq. 

Lines 20 and 21 set the variable add to c, if it is not yet defined, to indicate that this is the beginning of a segment 
5 of unmatched data. Line 25 moves the current position forward by 1 for the next iteration of the processing loop. Lines 
27 and 28 correspond to the event of finding a longest matched segment. Lines 28 and 29 call the procedure writeinst() 
to write out the COPY and ADD instructions according to the description given earlier. 

The first two arguments to writeinstO define the data for an ADD instruction if add is zero or positive. The second 
two arguments define parameters for the COPY instruction. The working of this procedure is straightforward so we shall 
10 omit its description. Lines 30 to 36 insert into table T MIN-1 positions at the end of the matched data segment. Lines 37 
and 38 increase c by the length of the match, and resets add to -1 . Lines 40 and 41 terminate processing if there is not 
sufficient data to be processed. Lines 43 and 44 output any final unmatched data from VERSION2 as an ADD instruction. 

Figure 6 shows a procedure to insert a position into the table T. Line 2 of Figure 6 indicates that the key is the MIN 
bytes of the sequence "seq" starting at the position p. Line 3 constructs the coded position. Line 4 inserts the pair (key, 
is pos) into the table T. 

Figure 7 shows a procedure to search for a match. Lines 3 and 4 construct the search key, which consists of MIN- 
1 bytes at the end of the current longest match length, plus a new unmatched byte. Lines 5 to 19 try to extend the match 
length if possible. This is done by looking at every element of the table T that matches the constructed search key and 
seeing if the part of the current match left to the key position matches with the corresponding part of the element being 
20 considered. This test is carried out on line 1 7. If this is true, then search() returns the starting position of the match on 
line 18. Line 20 returns to indicate that there is no match longer than "len". 

After the call to searchO is successful on line 1 3 of Figure 5, the match length is now known to be at least 1 more 
than the "len" value in Figure 5. Figure 8 shows the extendQ procedure, which extends the match to the right as far as 
possible. Lines 2 to 10 set up the correct sequences to search for matches, lines 11 to 13 perform the extension, line 
25 1 4 returns the entire matched length. 

When applied to the example of Figure 2, the above method will compute exactly the set of instructions exhibited 
in the same figure. Figure 6 shows the positions in the example VERSION1 and VERSION2 that would be inserted into 
table T. 

30 Security Enhancement 

Given two versions, VERSION1 and VERSION2, and a computed transformation, only the ADD instructions in the 
transformation carry raw data from VERSION2. Such data can be utilized by a snooper to gain valuable information 
about VERSION2. In applications having high level of security requirements, to prevent leakage of information, the ADD 

35 instruction can be modified as follows. First, each ADD instruction is modified to also have a copying address which 
would be some position randomly selected from VERSION1 in such a way that the data segment starting at that position 
is at least as long as the length of the ADD data. If this is not possible, the ADD data can be broken into smaller units. 
Then, the raw data is xor-ed with data from such a selected segment of data before output to the transformation. For 
example, using the same ADD instruction in Figure 2, if the selected position in VERSION 1 was 2, then this position 

40 would be output immediately after the control byte, and the two data bytes "xy" would be xor-ed with the two bytes "cd" 
before output. 

On decoding, the same xor operation must be done to each data byte before outputting. This works because the 
mathematical property of xor guarantees that when a byte is xor-ed twice with another same byte, it retains its original 
value. However, we can now guarantee that a snooper will not be able to gain any information from the transformed data 
45 bytes unless he or she already has a copy of VERSION1 , which was assumed to be secure. 

Figure 7 shows the instruction of Figure 4 encoded using this more secure method. The ADD instruction now has 
a position 2. The data bytes "x" and "y" are shown being xor-ed with "c" and "d" respectively. 
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APPENDIX 
(24 pages) 



I peregrine .zoo are, comi /n/arvphQr./a7/lcpv/anfr varts/3rg/lih^j 

*ifnde£ _VDELIA_H 
•defina _VDEXTA_H 1 

•ifndaf _JCPV 

•define KPV i 

•ifndef STD_C 

•ifdaf 9TOC 

•define STD„C l 

•elae 

*if cpluaplua 

•define __9TD_c 1 
• elae 

•define STD_C 0 

•endif /* cpluaplua*/ 

•endif /* STDC V 

•endif /• STD_C»/ 

•lfndaf _BEGIN_EXTER>TS_ 
•If cpluaplua 

•define _BEGIN_EXTERNS_ «xtern "C" { 
•define — END„EXTERN9__ } 
•elae 

•define jegin_sxterns_ 

•define _END_ EXTERNS_ 
•endif 

•endif /*J9EGIN_externs_V 



•ifndaf _ARG_ 

• if STD_C 

•define _ARC_{x) x 
lalaa 

•da£ine _ARG_(x) ( ) 
•endif 

•endif /*_AHG_*/ 

•if ndef Vold_t 

•if STD_C 

•da£ine Void_t 
#elae 

•da fine Void_t 
•andif 

•endll /"Voldl-tV 



void 
char 



» if ndef nil 

•define NlL(type) ((type)0) 
•endif /*NIL*/ 

• •ndif /*_KFV_*/ 

/* ueer-euppliad function* to do io V 
typedef atruot _vddiao_a vddiao^tr 

typedaf int(* Vdio_f )_ARG_( (int, Void_t*, int, long, vddiae_t*)); 
atruct _vddiee_a 

{ vdio^f raadf; /* to read data */ 

Vdio^f writaf; /• to write data */ 

long window; /* window size if any */ 

}; 
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1 peregrine . zoo , art . com) /n/<rrvphon/g7 /ker /sof rvara/ars/lib/vdelta /vd»lr« fa 



70 



75 



60! 
61: 
62: 

63 : 

64 : 
65: 
66: 
67: 
66: 
69: 
70: 
71: 
72: 
73: 



/* typea that can be given to the 10 function* */ 

•define VD_S0URCE 1 /* io on the source data */ 

•define VD_TARGET 2 /* io on the target dara •/ 

• define VD_J>ELTA 3 /* io on the delta data */ 

/* magic header for delta output •/ 
•define VD_MAGIC "vdOl" 

_BEGIN_EXTERNS_ 

extern long vddelta _ARG_( (Void_t* , long, void_t*. long, Vddisc^t*)); 

extern long vdupdate _ARG_( (Void_t» , long, VoLd_t*, long, vddi3c_::* ) 
_END_EXTERNS_ 

•endif /*_VDELTA_ H*/ 
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39: 
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) 

49 : 
SO: 

) 

SI: 
52: 

53 : 

54 : 
55: 
56: 
57: 



l Dere ? rine.zoQ.a?.t.CQm! /n/oryphon /g7 /kpv /Software /arc/1 ia/vdel-a/vrielhdr h 

•ifndef _VDELHDR_H 

•define _VDELHDR_H 1 

•include "vdslta.h" 

*if STD_C 

•include <srddef.h> 

• else 

•include <sys/typee . h> 
•endif 

iifdef DEBUG 
_BEGIN_EXTERN9_ ' 

extern int abort ( ) ; 

_END_EX TERNS _ 

#define ASSERT(p) ( (p) ? 0 : abort*)) 
•define DBTOTAL( t, v) (<t) +- (V)) 

idefine DBMAX(m,v) ( (m) - (m) > <v> ? <m) : <vj ) 

if else 

•define ASSERT(p) 
•define DBTOTAL( t, v) 
* define dbmax ( m, v ) 
•endif 

/* short- hand notation* •/ 
•define reg register 
•define uchar unsigned char 

•define uint unsigned int 

•define ulong unsigned long 

/* default window size - Chosen to suit malloc() even on 16-bit machines. ■/ 
•define MAXINT (( int) (( (uint) -0) » 1) ) 

•define maxwindow ( (int) (( (uint) -0) » 2)) 

• define DPLTWINDOW (MAXWINDOW <- (1«14) ? (1«14) : (1«16) ) 
•define HEADER (w) ((w)/4) 



•define M_MXN 



/* min number of bytes to match */ 



/* The hash funation is s(0J*elpha~3 + ■ [1] *alph»~7. + *[?.]*«1pha * s r3] */ 
•define vlpha 33 
• if 0 

•define Al(x,t) <ALPHA*(x)) 
•define A2(x,t) ( ALPHA* ALPHA* <x) ) 

•define A3(x,t) (ALPHA*ALPRA* ALPHA* (x) ) 

•else /* fast multiplication using shiftscadds •/ 



•define Al(x,t) 
•define A2(x,t) 
•define A3(x,t) 

•endif 

•define HINIT(h,a,t) 
•define HNEXT(h,e, tr 
idefine EQUAL (s>t) 



({t - (x)), (t i- (t«5) ) ) 
((t - (X)), (t + (t«6) + (t«10)) ) 

<(t- (X)), (t 1- (t«5) + ((tt(t«4))«6) - ((tr<r«4 ))«!!); 



((h - A3(sl0],t)), (h t. A2(Hl],t)}, (h — Al(s(2],' 
((h — A3<s[-l],t)), (h - Al<h,t) 1- m[Z)) > 



-s[3i) 



<(s)[0] — (t)(0] &s (s)Cll — (t)[l] \ 
(S)[2l <t)[2] && (i){3] — (t)C3] ) 

/• Every instruction will start with a control byte. 
»• For portability, only 8 bits of the byte are used. 



55 



15 



EP 0 717 353 A2 



Wed Aug 10 21:24:44 19 94 



10 



15 



20 



25 



30 



35 



40 



45 



50 



58 : 

59: 

50 : 

61: 

52: 

53: 

54 : 

65: 

66: 

67 

68 

69 

70 

71 

72 

73 

74 

75 

76 

77 

78 

79 

80 

81 

82 

B3 

84 

85 

86 

87 

88 

89 

90 

91 

92 

93 

94 

95 

96 

97 

98 : 

99 : 
100: 
101 
102 
103 
104 
105 
106 
107 
10 8 
109 
110 
111 
112 
113 
114: 
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asaa : 

iili; 



I peregrine. 2QQ, art ■comi/n/orvphorVg7/kpv/Scfrva rg/arr/''«b/vde'>A/vdslhdr h 
rha bits are used ax fallows: 

• of data involved, 
s defines 16 instruction types: 

an ADD instruction. 
2,3: COPY with K.QUICK addressing scheme. 
5: COPY with K^SELF, K_ HERE addressing schemes . 
7,8,9: COrY tfith K_RECENT addressing scheme. 

For the above types, ssss if not zero codes the size; 
otherwise/ the size is coded in subsequent bytes. 
,11: merged ADD/COPY with K_$ELF. K.HERE addresaing 
14,15: merged ADD/COPY with K_RECENT addressing. 

For merged ADD/COPY instructions, ssss is divided into "cc aa" 
where cc codes the size of COPY and aa codes the 3.ze of ADD. 



siz 

thi 

0 : 
1, 
4 , 
6, 
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# define vd.BITS 

•define S_BITS 
•define I_DIT9 



/* • bits usable in a byre 

/* bits for the size field 

/* bits for the instruction type 



/* The below macros compute the coding for a COPY addresa . 

** There are two caches, a "quick" cache of (K_QTYPE*256) addresses 

** and a revolving cache of K_RTYPE "recent" addresses. 

** First, we look in the quick cache to see if the address is there. 

** If ao, we use the cache index as the code. 

** Otherwise, we compute from 0, the current location and 

** the "recent" cache an address that is closest to the being coded address, 

** then code the difference. The type is set accordingly. 

** 

** An invariance is 2*K^MERGE + K_QTYPE -1—16 

V 

•define X.RTYPE 
•define K.QTYPE 
•define K_MERGE 
■define KJ3SIZE 

if define K.QEJICK 

•define X_SELF 

•define K.HERE 

•define K_RECENT 



4 /* # Of K — RECENT types */ 

3 /* t of K_QUICK types */ 

( K_RTYPE+2 ) /• # of types allowing add -copy */ 

(K_QTYFE«VD_3ITS) /* size of K_Q0ICX cache «/ 



1 /* start of K_QUICK types 

( K_QUICK+K_QTYPE ) 
(K_SEXF+1) 

{ K_HERE+1) /* start Of K_RECENT types */ 



■define K_ DDECL ( quick , recent , rhere ) /* cache decls in vdelta 

int quick [K^QSIZEl ; int recent ( K_RTYPE 1 ; int rhere/*;*/ 
•define K_UDECL( quick, recent, rhere) /* cache decls in vdupdate 

long quick(K_QSXZB]; long recent [K_RTYPE] ; int rhere/*;*/ 
•define K_IKIT( quick, recent, rhere) \ 
{ quick [rhere-0] - (1«7); \ 
while( (rhere +- 1) < K_QSX2E) quickCrherel - rhere + (i«7); \ 
recent (rhere-O] • (l«a); \ 

while ( (rhere +- 1) < K_RTYPS) recent [rhere] - (rhere+1) * ( 1«8 ) ; \ 

} 

•define K_UPD ATE (quick, recent, rhere, copy) \ 
{ quicfc[copy%X_QSIZE] - copy; \ 

if ((rhere 1) >- KJRTYPE) rhere - 0; recent [ rhere ] - copy; \ 

) 

•define Vt>_:9C0FY(k) <(Jc) > 0 &£ (k) < ( K_RECENT*K_RTYPE) ) 

•define K_ISMERGE(k) ( (k) >- (K_RECENT*MC — RTYPE) ) 



V 

V \ 

V \ 
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peregrine . zoo . att , cam: /n/qrvphnn/a7 /kpy/snf twage/are/* ; h /vd« ; /vn» } -f r 



"define A_9IZE 

"define A_;:3LQCAL(a) 

"define A_LPUT(e) (a) 

"define A_JPOT(a) ((a) 



({1«S_BIT3)-1) /* max local ADD size 

((a) <- jusizs } /* can be ceded Iccaliy 

/• coded Ideal value 
(A^SIZE-1) ) /* coded normal value 



"define A_lSHERE(i) ((ij & ASSIZE) 

"define A^.LGET(i) <(i> - ASSIZE) 
"define A_GET(s) ((a> + (A.SIZE+1) ) 



/* locally coded s.ze 



"define C_SIZE { ( 1«S_BITS) +1U1I.N-2 ) /* max local COPY size */ 

"define C_rs LOCAL ( s ) ({») <- C_SIZE ) /* can be coded legally -/ 

•define C_LPUT(s) <(•) - (M_MIN-1) ) /* coded local value 

"define C_PUT(a) ((a) - (C^SIZE-l) ) /* coded normal value 

"define c_l3HERE(i) <(i) 4 ( ( 1«3_BITS ) - 1) ) /* size was coded local v 

"define C_LGET(i) (<(i) & ( <1«S_BXTS) -1) ) - (M_MIN-i) ) 
"define C__GET ( 9 ) ((a) + (C_SIZE+1) ) 

"define K_PUT<k) ((k) « S_BITS) 
"define K_GET(i) ((i) » S_BITS) 

/* coding merged ADD/COPY instructions */ 

"define 2 /* bita for tiny ADD •/ 

"define A.TINYSIZE <1«A_TINY) /• max tiny ADD size V 

"define A_ISTINY(») <(*) <- A.TINYSIZE ) 

"define AJTPUT(s) {(a) - 1) 

•define A.TGET(i) (((i) & ( AJTINYSIZE- 1) ) + 1) 

"define C_TI3Y 2 /* bita for tiny copy 

"define C_TINYSIZE ((1«C_TINY) - I^-MIN-I) /* max tiny copy aize 

"define C_ISTI*rY(s) ((s) <- CJTIKYSIZE) 

"define C_TPUT<s) (((a) - M_MIN) « A_TINY) 

"define C_TGET(i) ((((i) » A^TINY) & ( ( 1«C_TINY) -1) > - *t_MI>T j 

"define K_TPUT(k) ( { ( k } +K_J4ERGE ) « S_8IT3) 

"define MEMCPY ( to , from, n ) \ 
switch (n) \ 

{ default: memcpy ( (Void_t* ) to, (Void_t* ) from, ( size_ t) n) ; \ 
to +- m from +• n; break; \ 
case 7 : »to++ - •from++j \ 
case 6 : *to++ - *from++; \ 
caae 5 : *to+i* - *from++; \ 
case 4 : *to-H- - *from++; \ 
caae 3 s *to++ • •from**; \ 
case 2 : *to++ - "from*-; \ 
caae 1 : *to++ - •from+f; \ 
caae 0 : break? \ 

} 

/* Below here ia code for a buffered I/O aubayatem to speed up 1/0 »/ 
"define X_SHXFT 7 

■ define X_MORE (l«r_9HIFT) /* continuation bit 

"define I_CODE(n) ( { uchar) ( (n) & ( I_MORE- 1) ) ) /* get lowor bits 

/* structure to do buffered 10 */ 
typadef etruct _vdio_e 
{ uchar* next ; 

uchar* endb; 

Vddiac.t* disc; 
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sereqrir.e 20Q.att.eomi /rVqrvphon/q? /:<pv /Software /arc/lih/ vdelta/vdelhd-.>. 



here ; 

buf [1024] ; 



long 
uchar 
} Vdio_t; 

•define READF(io) ((io) 

•define WRITEF(io) 

f define BUF(io) 

•define BUFSiZE(io) 

•define KEXT(io) <<io) 

•define ENDB<io) ((io) 

•define oiSC(io) (<io) 

•define HERE(lo) ( ( io ) 

•define RINIT( io , dlac ) 
(io) 

•define WINIT< io , diac) 
(io) 

•define REMAIN ( io ) 

•define VDPUTC(io.C) 

•define VBGETC(io) 



•>diac->read£ ) 

( ( io ) - >diae- >write£ ) 

( (io) ->buf ) 

sizeof ( (io) ->buf ) 
•>next) 
>endb) 
>diac) 
>here ) 

((io)->andb - (;io)->next - (io)->buf), \ 
>here - 0. (io>->disc - (diac) ) 

((io)->endb - ({io)->next - (io)->buf) + BU?SIZE( io ) , \ 
>hera • 0, (io)->diac - (diac) ) 

(SNDB(io) - NEXT(io)) 

<<REMAXN<io) > 0 || <*_vdflabuf ) (io) > 0) ? \ 
(int) (*(io)->next-r- -(c)) : -1 ) 
( ( REMAIN ( io ) > 0 U (*_Vdf ilbuf) (io) > 0) ? \ 
(int) (* (io) ->r.ext*-) ; -1 ) 



typedef struct _vdbuflo_a 



( 



) 

#define _vdfilbuf 

•define _vdflabuf 

* define _vde,etu 

idefine _Vdputu 

•define _Vdread 
•define Vdwrite 



ulong) ) ; 
uchar* , int ) ) ; 
uchar", int)); 



int ( * vdf ilbuf )_ARG_< (VdiO_f ) ) ; 
int ( • vdf labuf ) _ARG_( ( Vdio.t* ) ) ; 
ulo ng ( * vdge tu ) _ARG_ ( ( vdio_t * , ulong ) ) 
int ( • vdputu )_ARG_( ( Vdio.t* , 
int ( * vdre ad ) — ARG — ( ( Vdio_t« , 
int ( * vdwrite )_ARG_( (Vdio.t* 
Vdbufio_t; 

_Vdbuf io . vdf ilbuf 
_Vdbuf io . vdf labuf 

_Vdbu£io . vdgetu 
_Vdbuf io . vdputu 
_Vdbufio. vdre ad 
_Vdbufio. vdwrite 



_BEGIN_EXTERNS_ 
extern vdbufio.t 
extern void_t" 
extern Void_t* 
extern void 
_END_EXTERNS_ 



_Vdbufioj 

roarocpy _arg_( (Void.t* , 
malloc _ARG_( (size_t) ) 
free _ARG_< (Void_t*) ) ; 



conat void_t*, oize_t)); 



•endif /*„VDELHDR_HV 
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, paracrine . zoo . a^t. . <^m! /rVqrvr>hon/a7 /kpv/So f twars /src/lib/rdel ta/vddsita , - 
•include "vdelhdx.h" 

/* compute a transformation that takes source data to target data 

Written by (Kiem- ) Phong Vo, kpv3reflaarch.ati.com, 5/20/94 



*/ 

*ifdef DS3UG 

long s_copy , s_add 

long N_oopy, tf_add 

long M_copy, M_add 

long N_merge ; 

•endlf 



/* amount of ir.put covered ay COPY and a: 
/* # of COPY and ADD instructions 
/• max size of a COPY or add instruction 
/• • of merged instructions 



V 
•/ 

V 



"define MERGABLE ( a . c , k ) ((a) > 0 fab A_ISTINY(a) &6 \ 
(C) > 0 &; C_XSTI>TY(c) &fi \ 
(k) >» X_SELF ) 



typedef struct _match_a Match_t ; 

typedef struct _table_s Table_t; 
struct __match_s 
C Match.t* next; 

In- 
struct _table_s 



/* linked list ptr 



vdio_t 


io; 


/• 


io structure 


•/ 


uchar* 


arc; 


/* 


source string 


V 


int 


n_arc; 








uchar* 


tar; 


/* 


target string 


V 


int 


n_tar; 








K_DDECL (<JUiCk, 


recent, rhere ) ; 


/* 


address caches 


*/ 


Match_t* 


base ; 


/* 


base of elements 


V 


int 


size ; 


/■ 


size of h»Rh table 


V 


Match_t** 


table; 


/* 


hash table 


V 



}; 

/* encode and output delta instructions V 
•if STD_C 

static vdputinat(Table_t* tab, uchar* begs, uchar* here, Match_t* match, 
• else 

static vdputir.it (tab, begs, here, match, n_copy) 
•Table.t* tab; 

uchar* bega; /* ADD data if any */ 

uchar* here; /* current location •/ 

Match.t* match; /* beat match if any V 

int n_copyj /* length of match */ 

fendif 



Lnt n_copyi 



{ 



reg int n_add, i_add, i_eopy, k_type: 
reg int n, c_addr, copy* beet, d; 

a_add - begs ? here-begs : 0; 

c_addr - (here- tab- >tar)+tab->n_arc; 
k_type - 0; 



/* add 812 a 

/* current address 



« / 



if (match) /* proceae the COPY instruction */ 

( /**/DBT0TAL(N_COpy,l) ; DBT0TAL( 9_copy , n_copy > ; D8MAX(M_ccpy , 

beat * copy - match - tab->basej 
k_type - K_SELF; 
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67 




68 




69 




70 




71 




72 




73 




74 




75 




76 




77 




78 




79 




80 




81 




82 




83 




84! 


85 




86 




87 




88 




89 




90 




91 




92 




93 




94 


1 


95 




96 




97 


{ 


98 




99 




100 




101 




102 




103 




104 




10 5 




106 




10 7 




108 




10 9 


> 


110 




111 


if 


112 


{ 


) 


113: 


114: 


115 




116 




117 




118 





peregrine zoo . att , com; /n/qrvphQn/q7/kpv/Saftvarft/are/lib/vdelr a/vddftlta 



i£((d 3 c_addr - copy) < beet) 
{ beat - d; 

k_typ* • K_HERE; 

> 



{ 



) 



0; n < K_RTYPE; i-*n) 

lf((d - copy - tab->recent [n] } < 0 

continue; 
beat - d; 

k_type - K_RECENT-rn; 



d >= best) 



If {best >- I_MORE && tab->quick[n - copy%K_QSIZE3 copy) 
{ for(d - K_QTYPE-1; d > 0; --d) 

if (n >• (d«VD_SITS) ) 
break; 

beet - n - (d«VD_BITS); /"/ASSERT J best < (1«VD_BITS) ) ; 
k_type * X_QUrCK+d; 

} 

/**/ASSERT(best >- 0); 

/**/ASSERT( (}C — type*^K_MBRCE) < <l«I^aiT5) ); 
/* update address cache* */ 

K_UPDATE(tab->quick, tab->recent , tab->rhere , copy) ; 

/* see if mergable to last ADD instruction */ 
if (MERGABLE(n_add,n_copy,k_type) ) 



( 
} 

else 

( 



} 



/* • /D 8 TOTAL ( N_merge , 1 ) ; 
i_edd - KJTPUT ( k_ty pe ) . A_TFUT ( n_add ) , C.TPUT ( n_Copy ; ; 



i_copy - K_PUT(k_type) ; 
if (C_ISLOCAI.<n_copy) ) 

i-copy |- c_LPUT(n_copy) ; 



/**/DBTOTAL(N_add,l> ; DBTOTAL ( S_add , n_add ) ; DBMAX (M.add, n_add) ; 

0; 



if ( ! MERGABLE ( n_add , n^copy , k_type ) ) 

i_add - A_ISLOCAL(n_add) ? A_LPUT ( n_add ) 



iX(VDPUTC<<vdio_t«)tab,i_add) < 0 ) 

return -1; 
if (lA_I3L0CXX(B_add) &fi 

< *_Vdputu > ( ( Vdio^t * } t ab , { ulong ) A_PL*T ( n_add ) ) < 0 ) 

return -l; 

if ( (•_vdwrite)<<Vdio_t*)tab, begs, n_add) < 0 ) 
raturn -1; 



if ( !MERGABLB(n_add,n_copy,k_.tYpe) 6& VDPUTC( (Vdio_t* ) tab, i_copy ) < 0 

return -1; 

if { !C_ISLOCAL(n_copy) &6 

(*_Vdputu) ( <Vdio_t*}tab, (uioRg)C_PUT{n_copy) ) < 0 ) 
return - 1 ; 
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160 
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178: 



} 

else 

{ 

} 



Wed Sep 28 08:36:11 1994 

perecrrlr.e . ZOO . att . coml /n /gryphon/ g7 /kpv/Sof twaro. /arc/lib /vd al -.a; vddelta r 

if <k_type >- K.QUICK && k_type < ( K_QUICX-K_.jTYPE) ) 
( if (VDPUTC( (Vdio_t«jtab, <uchar)best; < o ) 

return -1; 

) 

else 

{ if ( ('.vdputuj ( (Vdlo^t* )tab, (ulong)best) < 3 ; 

return -1; 

} 



if ( {*_vdflabuf ) ( (Vdio_t*)tab) < 0) 
return -1; 



return 0 ; 



/* Fold a string */ 

#if sro.c 

static vdfold(Table_t* tab, int output) 
#els« 

static vdfold(tab, output) 

Table.t* tab; 

int output ; 

•endif 

{ 

rag ulong 
reg uchar 
reg Match_t 
reg uchar 
rag int 
reg int 
reg uchar 
reg Match_t 



*ey, n; 

*s, *im, *ends, *sa, «heade? 
*m, *list, *cunn, *beatm; 
*add, *endfold; 

head, len, n_src ■ tab->n_arc; 
■ize - tab->size; 
*irc - tab->arc, *tar - tab->tar; 
♦base - tab->basa, *»table - tab- > table; 



if ( I output) 



{ 



} 

else 

{ 



if (tab->n_arc < M^lIN) 

return 0; 
endfold - (a - arc) + tab->n_src; 
curm - base; 



endfold - (a - tar) + tab->n_tar; 

curm - baee*n_arc; 

if <tab->n_tar < m_minj 

return vdputinat (tab, a , endfold, nil (Mat ch_t« ) , o > ; 



add • NIL (uchar*) ; 
bestm - NIL(Mateh_t* ) ; 
len - H^MItf-1; 
HINIT(key,s,n); 
for<; ; ) 

C for(;;) /• search for the longest match */ 

{ if(l(»* table Ckey&size] ) ) 

goto endsearch; 
list - m - m->next; /• head of list */ 

if(beeta) /• skip over past elements */ 
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233 t 

234: 
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«»r«flrir.e . 2QQ.att.gomi /w/qrvohaii/q? /kpv/Softwara /are/1 ib/vde 1-a/vdda lta . e 

{ for< ; : > 

C if (m >» oestrrn-len) 

break; 

if((m - m->next) — list) 
goto endaearch; 

> 



head - len - (M_MIN-1); /* header before the match •/ 
heade - at- he ad; 

for(; ; ) 

{ if ( { n - m-baa«; < n_arc) 

{ if(n < head) 

goto next; 
am - arc - n; 



) 

elae 

( 



) 



if<(n -- n_arc) < haad) 

goto next; 
am ■ tar - n; 



/* make sure that the MjttiN bytea match »/ 
if ( i EQUAL ( heade , am) ) 
goto next; 

/* make ture thia is a real match */ 
for (am head, aa - a; at < heade; ) 
if(*em-r* i- »fla++) 
goto next j 

aa +- M_MIN; 
am +- M_MIN\- 
ends • android; 

if<(m-baie) < n^src 6« (n - ( src+n_src ) - am < rer.ds-s 

ends =■ s+n; 
for(; if < enda; ++aa, —am) 
if(*am I- *sa) 

goto extend; 

goto extend; 

next: if((o " m->next) — list ) 
goto endaearch: 

} 

extend: beatm - m-head; 
n • len; 
len - aa-a; 

if (aa >- endfold) /* already match everything */ 

goto ends ear eh; 

/* oheok for a -longer match */ 
as HJMIN-1; 
if (len ni-1) 

HNEXT(key,ae,n) ; 
elae HINIT(key , as . n) ; 



endaearch: 

if (beatm) 
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286: 
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293 t 
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297 



} 



C 



if (output && vdputinat(tab,add.a.begt:r.,len) < 0} 
return -1; 

/* add a aufficiant number of auff.cea •/ 

ends • (s +• len) ; 

as - ends - (M_MZN-i) : 

if ( i citput) 

curai ■ base - (ss-arc) ; 
else curm - baae - n_arc - (as -car); 

len - H-Ml.NM; 
add - ?IIL(uchar* ) ; 
beatm - NIL(Match_t*) ; 



} 

• Ida 

{ 



if ( I add) 

add = a; 

98 - s; 

end* - <a +- 1) ; 



/* add om prefix */ 



if(enda > (endfold - (M_MIN-1) ) ) 

enda - endfold - (NUWIM-1); 



if (99 < end*) for( ; : ) 
{ n ■ icey&aize; 

if ( i (m - tableCnl ) ) 

curm->next - curm; 

else 

{ curm->next - m->naxt; 

m->next - curm; 

} 

table [n] ■ curmT+; 

if((ea +- 1) >- ends) 

break; 
hnext ( key /SifH) ; 



/* add pref icea/auf f ices */ 



} 



if(e > endfold-K-MIM) 
{ if (i add) 

add - a; 

break; 

] 

HNEXT (key ,a,n) ; 



/* too ahorr. to match */ 



if (output) /* fluah output •/ 

return vdputinat < tab , add, android, NlL<Match_f } , 0 ) ; 
return 0; 



dlf 3XD C 

long vddaIta(Void_t* arc, long n_arc, Void_t* tar, long n_tar, Vddiac.f 
• elae 

long vddeltatarc, n_are, tar, n_tar, disc) 

Void_t* arc? /* aource atr^ng if not MULL */ 

long n_arc; /* length of source data */ 



diac) 
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298: 
299 : 
300: 
301: 
2: 
: 

304 : 
305: 

305 : 
307: 
308: 
309: 
310: 
311: 
312: 
313: 
314: 
315: 
316: 
317: 
318: 
319: 
320: 
321: 
322: 
323: 
324; 
325: 
326: 
327: 
328: 
329: 
330 : 
331: 
332: 
333 : 
334: 
335: 
336 ; 
337: 
338: 
339: 
340: 
341: 
342: 
343; 
344 i 
345: 
34 6 : 
347: 
348 : 
349: 
350: 
351: 
352: 
353 » 
354: 
355: 
356: 
357: 



Void_t» 

long 

vddisc_t» disc; 

ler.dif 

{ 

reg Lr.r 
reg long 
Table * 



tar; /• target string if not NULL 
n_tar; /* length of target data 
/* 10 discipline */ 



size, k, n. window; 
p; 

tab; 



<n_erc > 0 && isrc) ) 



if(!disc || !diac->writtf ' i 

(idiac*>readf &6 ((n_tar > 0 66 itar) 
return -i; 

if{n_tar < 0) 

return -1; 
if(n_src < 0) 

n_src - 0; 

tab.n_ arc » tab.n_tar » tab. size 3 0; 
tab. tar » tab . arc - NIL(uchar* ) ; 
tab. base - NIL(Match_t* ) ; 
tab. table - NIL (Match_t** ) ; 
WINIT<& tab. io, disc) ; 

if (disc->wlndow <» 0) 

window - DPLTWINDOW; 
else if (diac->vindow > MAXWINDOW) 

window - MAXWINDOW; 
•lse window - ( int )diac->window; 
if ( (long) window > n_tar) 

window - (int)ix. tar; 
if<n_src > 0 &6 (long) window > n_src) 

window * (int) nearer 

/* try to allocate working apace V 
while (window > 0) 

{ /* apace for the target string «/ 

size - (a_tar —Oil tar) ? 0 : window; 
if { (long)size > n_tar) 

size - (int)n_tar; 
if (size > 0 66 i( tab. tar - (uehar* >malloc(size*Biz*of (uchar ) ) ) : 

goto reduce .window ; 

/* apace for aliding header or source string */ 
if{nuarc <- 0) /• compression only •/ 

size - tar ? 0 ■ HEADER (window) > 
else /* differencing */ 

{ size - sro ? 0 : window; 

if ( (long) aize > n_arc) 

size - (int)n_arc; 



} 

if (size > 0 66 ! (tab. arc = t uchar« )malloc(size*sizeof { 
goto reduce .window 

/• space for th# haah table elements •/ 
aize ■ window < n_tar ? window : (int)n_tar: 
if(n_arc <- 0) 

size +- window < n.tar ? HEADER (window) : 0; 
else aize +■ window < n^irc ? window : (int)n_src; 
if (! (tab. base - <Match_t* )malioc(size*sizeof (Match_t ) ) ) ) 



) } J ) 
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358 

359 

360 

361 

362 

363 

364 « 

365 

366 

367 

368 

369 

370 

371 

372 

373 

374 

375 

376 : 

377; 

378 : 

379: 

380 : 

381: 

382: 

383: 

384: 

385 : 

386 

387 

388 

389 

390 

391 

392 

393 

394 

393 

396 

397 

398 

399 

400 

401 

402 

403 

404 

405 

406 

407 

408 

409 

410 

411 

412 

413 

414 

415 

416 

417 



0); 



goto reduce. window; 

/* space for the hash table */ 
p. - size/ 2; 

(size - n); while((n n-1) 
if(ai2e < 64) 

aize - 64; 

while ( I ( tab . table - (Match.t** jmalloc ( 3Lze«aiz«of (Match__* ■ : > > 
if ( (aize »- 1) <- 0 ) 

goto reduce_yindow; 

/* if get here, auccesaful ■/ 
tab. size » size-1; 
break ; 

reduce_window: 

if (tab. tar) 

{ free ( ( Void_t* ) tab . tar j ; 

tab. tar - MIL (uchar* ) : 

} 

if (tab. arc) 

{ free ( ( void_t« ) tab . arc ) ; 

tab. arc - Nll(uehar* ) ; 

) 

if (tab. base) 

{ free < < Vaid_t w ) tab . base ) ; 

tab. base - NlL<Match_t* ) ; 

) 

if ( <window »- 1) <- 0) 
return -1; 



/* amount processed */ 
n ■ 0; 

/* output magic bytaa and sizes */ 

for(k - 0; VD^MAGICtkJ; *++) 

if ( (* w vdwrite) (fctab.io, <uchar*)V0_MAGIC,k) i- k 
( *_vdputu) (&tab. io, (ulong)n_tar) <- o I I 
(»"vdputu) (iitab.io, (ulong)ruarc) <«■ 0 I I 
( *_Vdputu) (atab. io, (ulong) window) <= 0 ) 
goto done; 

/* do one window at a time */ 
while (n < n_t«r) 

{ /* prepare the source string V 

if(n_ sre <- 0) /* data compression •/ 
{ if(n <- 0) 

tab.n_sro - 0; 



elae 

{ 



size • HEADER { window) ; 
if (tar) 

tab. arc - tab. tar +■ tab.n_tar - 9iz«; 
else memcpy( ( Void_t* ) tab . are, 

(Void_t*) (tab. tar + tab.n_tar - size, 
aize ) ; 
tab.n_src - size: 
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413 

420 

421 

422 

423 

424 

425 

426 

427 

428 

429 

430: 

431 

432 

433 

434 

435 

436 

437 

438 

439 

440: 

441: 

442: 

) : 

443: 

444 : 

445: 

446: 

447: 

448: 

449: 

450: 

451: 

452: 

453: 

454: 

455: 

456: 

457: 

458: 

459: 

460: 

461: 

462: 

463 i 

464 

465 

466 

467 

468 

469 

470 

471 



) 



else 

( 



3 



/* data differencing •/ 
if (n < A_arc) 

{ if < n+window > n_src) 

p a n_src- window; 
viae p = n; 
if (arc) 

tab, arc - (uchar*)src +■ p; 

else 

{ size « ( «disc->reacf ) < VD_S0URCE, iab.3rc. 

window, p, disc); 

if (Size t- window) 
goto done ; 

) 

} /* else use last window */ 
tab.i\_src - window; 



/* prepare the target string */ 

size - (tutar-n) < window ? ( int J <n_.ta.r-n) : window; 
tab.n_.tar ■ size; 
if itar) 

tab. tar * (uchar*)tar + n; 

else 

( size - ( *di»c - >readf ) (VD_TARGET, tab. tar ; size, (long)n, disc 



) 



if ( (long) size i- tab.n_tar) 
goto done; 



/« reinitialize table before processing •/ 
for(k - tab. size; k >- 0; --k) 

tab.tablefk] - NlL(Match_t* ) ; 
K_I NIT ( tab , quick , tab . recent , tab . rhere ) ; 

if (tab.n_sre > 0 && vdfold( itab, 0) < 0) 

goto done; 
if (vdfold(fc*ab,l) < 0) 

goto dona; 

n +- size; 



done: 

if ( t tar &£ tab. tax) 

f raa < < Void_t* ) tab . tar ) ; 
if (tab. arc ft* <(n_src <- 0 fit itar) 

f raa ( ( Void_t* ) tab . arc ) ; 
if (tab. base) 

f raa ( ( Void_t* ) tab . baaa ) \ 
if (tab. table) 

free< (Void_t*)tab. table) ; 

return n; 



(n_src > 0 && isrc) ) ) 
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1; 

2: 

3 : 

4 : 

5: 
6: 

8 ! 

9 : 
10: 
11: 
12: 
13: 
14 : 
15: 
16: 
17: 
18: 
19: 
20: 
21: 
22: 
23: 
24: 
25: 
26; 
27: 
28 : 
29: 
30: 
31: 
32: 
33: 
34: 
35: 
36: 
37: 
38: 
39: 
40 : 
41: 
42: 
43: 
44: 
45: 
46 i 
47: 
48 : 
49: 
50: 
51: 
52: 
53: 
54 : 
55: 
56: 
57: 
58: 
59: 



SaSagiu aB^ ?oo att.CQmi / nyoT-yphon/g^/kav/Sof twaye/gye/l-b/vdel -a/v-ci--:^dara . >z 



» include "vdelhdr.h" 



Apply the transformation source ->target to reconstruct target 
Tf.li code in deaigned to work even l£ the local n-.ach-ne -as 
word ai2e smaller than that of the mach-ne vhere the delta 
was computed. A requirement ls that "long'* on the local 
machine must be large enough to hold source and target s::?3 
It la also assumed that if an array ls given, the size of 
that array In bytes must be storabie in an "int" . This is 
used in various oast from "long" to "lnt". 

Written by (Kiem-)Fhong vo, kpv3research.att.com, 5/20/94 



V 

typedef struct 



Vdio_t 

uchar* 

long 

uchar* 

long 

long 

long 

uchar 

char 

char 

char 



_table_s 
io; 
src; 
rusrc; 
tar; 
n_tar ; 
s_org; 
t_org ; 
data [129] , 
s_alloc; 
t_alloc; 
compress; 



lq structure 
source string 



} 



K_7DECL( quick, recent, rhere) ; 
Table.t; 



/* target string 

/* start of window in source 
/* start of window m target 
/* buffer for data transferring 
/* 1 if source was allocated 
/* 1 if target was allocated 
/* 1 if compressing only 
/* address caches 



V 
V 
V 
V 
V 
V 
V 



*if STD.C 

static vdunfold(Table_t* tab) 
• else 

static vdunfold(tab) 
Table_t* tab; 
•endif 

C 

reg long 
reg int 
reg uchar 
reg long 
reg Vdio_f 
reg vddisc_t* 



size, copy; 
inst, k_type, n, r; 
•tar, *src, *to, *fr; 
t, c_addr , n_tar, n_src; 
readf, writef; 
disc; 



n_tar - tab->n_tar; 
tar ■ tab->tar; 
n_src » tab->n_arc; 
src - tab->src; 

disc - tab- >io. disc; 
readf ■ disc -> readf ; 
writef * disc ->wr its f ; 

for(t - 0, c_addr - n_src; t < n_tar; ; 
( if ((inst - VDGETC((Vdio_f)tab) ) < 0) 

return -1; 
k.type - K_5BT(inst); 



if ( ivD_igcoPY(k_type) ) 

C if ( K_ISMERGE< k_type ) ) 



/* merge/add instruction 
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60 t 

fill 

62: 

63 i 

64 

65 

66 

67 

68 

69 

70 

71 

72 

73 

74 

75 

76 

77 

78 

79 

80 

> 

81: 

82: 

83: 

84; 

85 

86 

87 

88 

89 

90 

91 

92 

93 

94 

95 

96 

97 

98 

99 
100 
101: 
102: 
103 
104 
105 
106 
107 
10 8 
109 
110 
111 
112 
113 
114: 
115 
116 
117 
118 



mlam 

C 



else 

i 



size - A_TGET( inat ) ; 
else if (A_XSHERE(ixi9t) ) /* locally coded ADD s^ze 
size - A_LGET( ir.st) ; 

/* ncn- local ADD size 
if((size - VDGETC( (Vdio_t*)tab) ) < 0) 

return - 1 ; 
if (size >• I_MCRE a& 

(sire - (long) <*_vdgetu) ( (Vdio_t* ) tab, size) ) < 0} 
return -1; 
size - A_GET ( size ) ; 

) 

if ( (t+eize) > n_tar) 

return -1; 
C_addr t- si2e; 



/* out of sync »/ 



/* copy data from the delta stream to target */ 
for( ; ; J 

( if (I tar) 



{ 



) 

else 

{ 



) 



If ( (long) (n = sizeof (tab->data) ) > size) 

n - (int)size; 
if ( (*_vdread) ( (Vdio_t*)tab,tab->data,n) 

return -1; 
r - ("writef ) (VDJTARGET, 

(VoLd_t* )tab->data, n, 

tab- >t_org+t , disc ) ; 
if(r n) 

return -1; 



n - { int) size ; 

if ( (*_Vdread) ( ( vdio_t* ) tab, tar-M:, n) I- n) 
return -1; 



t +- n; 

if ( (size n) <- 0) 
break; 



} 



if (K_ISMERGE(k_type> ) 

{ size ■ c_TGET( inat ) ? 

k-type K^IERGB; 

goto do .copy; 

) 



if ( C_IS HERE ( inat ) ) /* locally coded COPY size */ 

size - C_LGET(inst) ; 

else 

C if ((size - VDGETC( ( vdio_t* ) tab) ) < 0) 

return -1; 
if (size >- J_M0RE km 

<aize - (long) <*_vdgetu) ( (Vdio_t*) tab, size) ) < 0) 
return - 1 ; 
size - C_GET(size); 



do_copy : 



iff (t+sizt) > n_tar) 
return -1; 



/• out of sync •/ 
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119 
120 
121 
122 

123 
124 
12S 
126 
127 
) 

128; 
129: 
130: 
131: 
132 
133 
134 
135 
136 
137 
138 
139 
140 
141 
142 
143 
144 
145 
146 
147 
n, 
148 
149 
150 
151 
152 
153 
154 
155 
156 
157 
158 
159 
160 
161 
162 
163 
164 i 
163 
166 
167 
168 
169 
170 
171 
172 
17 3 
174 : 
175: 



peregrine, zoo .art, com I /rVqr/phon/cr7/:icpv/S Dfr^re/grc/iib/VGe:ta/vdund^ i f > 

if {(copy » VDGETC ( ( Vdio_t* ) tab ) ) < 0) 
return - 1 ; 

if {k_type >» K_CUICK x_type < ; X_2U:cKi-K_STY?E : ) 

copy - rab->quick[copy r ; ; ;<_type-K_Q r J:cx «V3_BirS5; 

else 

{ if; copy >» i_MORS && 

(copy - (long) (*_vdgatu j( (Vdlo_t») tab, =spy) ) < : ; 
return -1: 

Lf(Jc_type >- k_recent <_type < ',:<_recen-t-k_rty?e:. 

copy tab->recent 'k_type - K_P.EC EX I ] ; 
else if<fc_type — K.HERE) 

copy = c^addr - copy; 
/• else fc_type K_SELF 

> 

K_UPDATE(tab->quic)c, tab- > re cent, tab- >r here, copy) ; 
c_addr — size; 

if (copy < n_arc) /* copy from source data */ 

C if ( (copy-»-size ) > n.src) /« out of sync V 

return -1; 

if(arc) 

£ n • (intjsize; 

fr =» src^-copy; 
if (tar) 



) 

else 

t 



{ 

} 

else 

C 



} 

t T« 



to - tar-t ; 
MEMCPY< to , f r , n) ; 



r - <*vritef ) (VD_ TARGET, Void_-*;fr 
disc ; ; 



tab->t_org-t, 

if (r n) 

return -1; 



if ( tab - >compreaa ) 

( copy +■ tab->t_org - tab->n_src; 

inst - VD_TAJRGET; 

} 

else 

( copy +- tab->s_org; 

inst - VD__SOURCE; 

) 

for( : : ) 
t 



if {tar) 



} 

else 

{ 



n - (int)size; 

r - ( *reedf ) < mat 

(Void_^ w : ( :arr: 
copy, dia-i; 



n = aizeof (tab- >caca) ; 
if; (long)ti > size 

n * ( int ) si2e : 
r - ( *readf ) ( lr.st 

(Void_t* i tab->data . n, 
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177 

178 

179 

180 

181 
182 
18 3 
184 
185 
18 6 

18 7 
188 
189 
190 
191 

19 2 
193 
194 i 
/ 

19 5 
196 
19 7 
198 
199 
200 
201 

202 

203 

204 

205: 

206 

207 

208 

209 

210 

211 

212 

313 t 

214 

215 

216 

217 

218 

219 

220 

221 

222 

223 

224 

225 

226 

227 

228 

229 

230 

231 

232 



wr^r^g tnn ar.r. .nomi / /g r yphon /a ? /kov /Sof tva re /src /l ib/YCC 1 -a/vtiusdtt wC , £ 



copy/ disc ;. r 
I - n) 

returr. -1: 

r ■ ( •writef ) (VD_T~RGET, 

(Void„t« )tab->data, n 



tab->t_org- 



disc^ ; 



} 



} 

ii(r i = n) 

return -1: 

t — n; 

if ( (size -- nj < a 0) 

break; 
oopy r- n; 



) 



} 

•lfle /* copy from target data */ 
( copy n_irc: 

if (copy >- t | I (copy-size) > r._tar) /* out-of -syr.c - 

return - 1 ; 

for{;;) /* allow for copying overlapped data */ 
C rag long a, a; 

if ( (a - t-copy) > size) 
a • aize; 

if < tar) 

( to - tarrt; fr - tar+copy; n - (int)s 

MEMCPY ( to , f r * n ) ; 
t +- n; 
goto next; 

} 



/* hard read/write */ 
a ■ copy; 
for( ; ; ) 

{ if(<long)<n- aizeof ( tab->data) ) > g> 

n - (int)a; 
r - ( *readf ) {VDJTARGET, 

(VoidLt* )tab->data, n, 
a + tab->t_org, diac ): 

if<r I- n) 

return -1; 
r - ( *writef) (VDJTARGET, 

(Void_t* )tab->data, a. 
t + tab->t_org, disc }• 

if(r !- n) 

return - 1 ; 

t +• n; 

if<(« n) <- 0) 
break; 

a +■ n; 



n»xt : 
} 



} 

if ((size s) 
break ; 



0) 



55 



30 



EP 0 717 353 A2 



Sun Aug 14 11:55:45 1994 



I oere?r-ne . zoo ■ at* . coml /n/?rvphon/y7 /Tcpv/Sof tvara /arc/lib/vdelta/vdusda-g 



ro 



75 



20 



25 



30 



35 



40 



45 



50 



233 

234 

235 

236 

237 

238 

239 

240 

241 

242 
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244 
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249 

250 
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252; 

253: 

254: 

255! 

256 

257 
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259 

260 

261 

262 

263 

264 

265 

266 

267 

268 

269 

270 

271 

272 

273 

274 

275 

276 

277 j 

278 

279 

280 

281 

282 

281 

284 

285 

286 

287 

288 

289 

290 

291 

292 



return 0 ; 

) 

*if STD_C 

long vdupdata<Void_t* arc, long rr_arc, Vcid_t* tar, long n_:ar , vddisc_t« 
»elae 

long vdupdate ( arc, n_sre, tar, i^ur, disc} 

Void_jt* arc? /* source string if any »/ 

long n_src; /* length of arc */ 

voidLt* tar; /* target apace if any */ 

long n_tar; /• size of tar */ 

Vddiac.t* disc; 

Hendif 

C 

Table.t tab; 

uchar *data, magic [8]; 
int n, r; 

long t, p. window; 
Vdio.f readf, writef; 



(!tar && idiac->writef ) ) 



if(idiae || Idisoreadf 

raturn -1; 
readf - diac->readf; 
writaf * diae->writef ; 

/* initialize I/O buffer «/ 
RINIT(&tab.io,diac) ; 

/* check magic header •/ 
data - (uchar*)<VD_MAGlC); 
for (n - 0; data In); --n) 



if U *_vdread) (fttab. io, magic, n) I- n) 

return -1; 
for(n — l; n >- 0; --n) 

if(data[n] i-raagic[nl) 
return -1; 

/* get true target aize */ 

if((t ■ (long) (^Vdgetu) (*tab.io,0) ) < 0 

return -lj 
n_tar - t; 



(tar && n^tar !- t) 



/* get true source sixe */ 

if({t ■ (long) C.Vdgetu) ( lit ab.io,0)) < 0 II (arc && n_aro 1- t) ) 

return -1; 
n_src - t; 

/* g»t window aize */ 

if ((window - (long) (•_Vdgetu) (&tab. io,0) ) < 0) 
return -1; 

tab. compress • n_sro 0 ? 1 : Oi 

/* if we have space, it'll be faster to unfold */ 
tab. tar - tab. arc - NIL(uchar* ) ; 
tab,t_alloc - tab.e__alloc - 0; 
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293 
294 
295 
296 
297 
296 
29 9 
300 
301 
} 

302: 

303 : 

304: 

305: 

306 

30? 

306 

309 

310 

311 

312 

313 

314: 

315: 

316: 

317: 

31Bt 

319: 

330: 

321: 

322: 

323: 

3 24: 

,n); 

325: 

326; 

327: 

ac); 

328: 

329: 

330: 

331 

332 

333 

334 

2 * i 

- , i 

337 

338 

339 

340 

341 

342 

343 

344 

345 

346 

347 

348 

349 



if(n_tar > 0 && :tar && window < ( long ) MAXINT) 

n - (int) window; 
el a* n - 0; 

if(n > 0 &fc (tab. tar - (uchar* )malloc( n*si2eof ( uchar; ) ) ) 
^ab.t_alloc - 1; 

if(n_src > 0 fifi i arc 4& window < ( long )MAXINT) 
n - ( in- j wir.dc .•; 

elae if(n_arc « 0 && window < n_tar && itar && HEADER (window) < ( long )M*XIN1 

n - ( int) header (window ) ; 
elae n - 3; 

if(n > 0 s& (.tab. arc - (uehar* )malloc< n»9izeof ( uchar) ) ) ) 
tab.a_alloc - 1; 

£or(t ■ 0; t < n_tar; ) 

{ tab.t_org - t; /« current location in target atream */ 

lf(n_erc »■ 0 ) /* data compression */ 
{ tab . a_org * 0 ; 

ifft — 0) 

tab,n_src ■ 0; 



} 

elaa 

t 



else 

I 



tab.n_arc - HEADER (window) ; 
p - t - tab.n_src; 
if(tar) 

tab. ere - (uchar*) tar * p; 
•lae if (tab. arc) 



C 



n - (int)tab.n_arc; 
if (tab. tar) 



•lae 

C 



data - tab. tar + tab.n_tar - n; 
mamcpy( (Void_t* > tab. arc, ( Void_t w >data 



r - (*raadf ) (VD_TARGET, tab . arc n, p , di 



if(r t- n) 

goto done; 



} 



/• data differencing •/ 
tab.n^arc ■ window; 
i*(t < n_arc) 

{ if ( (t+wlndow) > n_«rc) 

p - n_arc- window ; 
•lae p - t; 

tab.a_Qrg - p; 

if (arc) 

tab.src - (uchar*) arc t p; 
•la* if (tab. arc) 
( n - ( mtjtab .n_arc; 

r - (•raadf ) (VD_30URCE, tab . arc,n,p, diac; ; 

if(r i- n) 

goto dona/ 
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70 



75 



20 



25 



350 

351 

352 

353 

354 

355 

356 

357 

358 

359 

360: 

361: 

362: 

C) ; 

363: 

364: 

365 

366 

367 

368 

369 

370 

371 

372: 

373: 

374: 

375: 

376: 

377: 



} 



) 



) 



ii (tar) 

tab. tar - ( uchar* )tari-t ; 
tab.n_tar » w: ^dow < (n_tar-t) ? window : ( n_tar- t ) ; 

x_:nit< tab. quick, tab. recent, tab.rhere) ; 
if (vdunfold(itab) < 0) 

goto done; 
if ( 1 tar 6& tab . tar j 

C p - ( *writef ) ( VD_TARGET, { Void_t* ) tab . tar, ( ir.t ) tab . 

if(p i- tab.n.tar) 
goto done; 



t +- tab.n_tar; 



dona : 

if { tab . t_alloc ) 

free( (Void_t* ) tab. tar ) ; 
if (tab.s_alloc) 

free ( ( Void_t* ) tab . arc } j 

return t; 
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10 
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1 : 




2 - 




3 




4 




5 




6 




7 




a 




9 




10 




11 




12 




13 




14 




15 




16 




17 




18 




19 




20 j 


21; 


22: 


23 




24 




25 




26: 


27 




26 


: 


29 




30 




31 




32 




33 




34 




35 


: 


36 




37 




38 




39 


i 


40 




41: 


42: 


43 : 


44: 


45: 


46: 


47: 


46: 


49 : 


50: 


51: 


52: 


53: 


54: 


55: 


56: 


57: 


58 : 


59: 



* include "vdelhdr.h" 



»tf S7D_C 

static _vd£ilbu£ (reg Vdio_t* io) 
irelae 

static _vdfilbuf <lo) 

reg Vdio_t« io : 

«endif 

{ reg int ti; 



if((n - (*READF{iO)){VD_DELTA,BUF(io),BL'PSIZE{iO),KERE(io) / DISC(lO})> > 0) 
{ ENDB(iO) - (HEXT(iO) - BUF(io); + n; 

HERE(io) n; 

} 

return n; 

J 

*if 3TD_C 

static _vdfl«buf (reg vdio_t* io) 
• else 

static .vdflsbuf (io) 

reg Vdio_t« io; 

•endif 

{ reg int n; 

if({n ■ NEXT ( io ) - BUF(to>) > 0 6ft 

( *WRITEF( io ) ) (VD_DELTA,BnF(iO) ,n, HERE(io) ,0130(10) ) I- n) 
return -1; 



HERE(io) +- n; 
NEX2(3.o) - BUF(lo) ; 
return BUFSIZE(io) ; 

} 

flf 9TD_C 

static ulong _vdgetu(reg Vdio_t* io, reg ulong v) 
• else 

atatio ulong _vdgetu( io, v) 
reg vdio_t* io; 
reg ulong v; 
•endif 

( reg int c; 

for(v 6- I.J10RE-1; ; ) 

( if<(c - VDCBTC(io)) < 0) 

return ( ulo ng ) ( - 1L ) ; 

if(KCftl^lOM) ) 

return ( (V«I_SHIFT) i c): 
v - (v«I_9HIFT> | (c 6 (I_MORE-l)); 



) 



} 



#if 3TD.C 

static _vdputu<reg vdio_t* io, ulong v) 
♦ else 

•tatic _vdputu(io, v) 
reg Vdio_t* io; 
reg ulong v; 
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103 

104 

105 
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107: 

108 
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114 

115 

116 

117 
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119: 



I pe.rftgrint.ZOP att eora: /n/grvphon/Q7/Tgpv/9ofr.u a r>i/Bre/lvb/vAelr ay -yci- r, r- 



#endi* 

{ 

reg uchar 
rag int 
uchar 



•a, * next i 

len; 

c C sizeof ( ulong ) -1 i ; 



a * nexr - &c [ si2eof ; c ; -1 J ; 
*« » I_COOE( v) ; 
whiie((v »- I_9HIFT) ) 

*--a - I_CODE{v) | I^MORE; 
len - (next- a) - 1; 

if (REMAIN ( io ) < len && _vdf labuf ( io ) <*= 0) 
return -i; 

next * io->next; 
switch (len) 

C 

default: memcpy ( { Void_t* ) next , ( Void_t* ) a , len) ; next +- len; break; 
caee 3: •next+f - *i-r-; 
case 2: *next+* • • «++; 
case 1: *ntxt-* - *s; 

} 

io->next ■ next; 
return len; 

) 

*if STD_C 

static _vdread(Vdio_t* io, reg uahar* a, reg int n) 
#elae 

static _vdread(io, a, n) 
Vdio.t* io ; 

reg uchar* a; 
reg int n; 
«endi* 
C 



reg uchar* 
reg int 



next; 
r, a; 



for(m - n; m > 0; ) 

{ if((r - REMAIN ( io ) ) <- 0 66 (r - _vdf ilbuf ( io) ) <- 0) 

break; 
if(r > m) 

r - m; 

next ■ io->nextj 
KEMCPY(fl,next,r); 
io->next - next; 

m - ■ r; 

} 

return n-m; 

} 

*if 9TD_C 

static _vdwrite( Vdio^t* io, reg uchar* a, reg int n) 
»elae 

atatxc _vdwr±te(io, a, n) 
Vdio_t* io; 
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128 

129 

130 

131: 

132: 

133; 

134: 

135: 

13 6 

137 

138 

139 

140 

141 

142 

143 

144 

145 

146 

147 

148: 

149 i 

150: 



reg uchar* 
r«g inr 
*andif 

( 

reg uchar* 
reg int 



? «r» ? ri r« zoo att . com' /r /gryphon/ a 7 /kpv/Scltvarft/Brc/lib/vdglta/vdiQ c 

8 ; 

n; 



next; 

v, m; 



for cm = n; m > 0; ) 

{ if((w - RZMMN(io)) <- 0 && (w - 

break i 
if (w > zn) 

w - m; 

next - io->next; 
MZMC?lT(next,a,W); 
io->next - next; 

m w; 



_vdf isbuf <io) ) <- 0) 



) 

return n-m; 



vdbufio_t _vdbufio - 
{ _vdfilbuf, 

_vdfl«buf , 

_vdgetu , 

_vdputu, 

jvdread, 

_vdwrite 

}; 



Claims 

1 . In a computer, the improvement comprising: 

a) program means for producing instructions which allow replication of a second version of a binary file, based 
on a first version, without access to the second version. 

2. A method of replicating a second version of a binary file, which is derived from a first version, comprising the following 
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a) creating a sequence of instructions, each of which generates a character sequence, which, when concate- 
nated, replicate the second version; and 

b) executing the instructions. 

3. For a digital computer, the improvement comprising: 
a) first program means for 

i) examining a first and a second file and 

ii) producing a sequence of instructions which, when executed, concatenate 

A) parts of the first file with 

B) parts of the second file, without access to the second file, 
in order to replicate the second file. 
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4. The improvement according to claim 3, and further comprising second program means for executing the sequence 
of instructions, for replicating the second file. 

5. A method of saving a later version of a computer file, comprising the following steps: 

a) comparing the later version with an earlier version, and identifying 

i) similar passages, where the later version is similar to the earlier version, and 

ii) difference passages, where the later version is different from the earlier version; 

b) storing the address where each similar passage occurs in the earlier version; and 

c) storing each difference passage, together with the address of its occurrence in the later version. 

6. A process of information replication, comprising the following steps: 

a) finding, at a first site, 

i) similarities and 

ii) differences 

between a first file and a second file; 

b) maintaining, at a second site, a copy of the first file; 

c) transmitting the following to the second site: 

25 i) locations of the similarities, 

ii) the differences themselves, and 

iii) information to enable replication of the second file, based on (c)(i), (c)(ii), and the second file. 
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7. A method of updating an old version of a file into a new version, comprising the following steps: 
a) receiving instructions which order one or more of the following to occur: 



i) copying a specified part of the old version into a specified location of the new version; 

ii) copying a specified part of the new version into a specified location of the new version; and 
35 iii) adding specified bytes to a specified location in the new version; 

and 

b) executing the instructions. 

40 8. A system for generating data indicative of differences between first and second versions of a file, comprising: 
a) means for deriving a sequence comprising the following instructions: 

i) a COPY instruction which orders that characters be copied from 

45 

A) a source location in either the first or second version, to 

B) a destination location in the second version; and 

ii) an ADD instruction which orders that specified characters be added to specified locations in the second 
so version. 
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WORD — »«When buying coconuts, make sure that they are crack free and 
POSITION-^ I-* 2-* 3 4- 5 6 7 8 9 10 11 

have no maid on them. Shake them to make sure that they are 
12 13 14 15 16 17 18 19 20 21 22 23 24 

heavy with water. Now hold a coconut in one hand aver a sink 
25 26 27 28 29 3031 32 33 34- 35 3637 

and hit it around the center with the claw end of a hammer. 
38 39 40 41 42 43 44 45 46 47 48 49 50 
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Hawaiian all 
When buyingAcocanuts, make sureA5mfc-th$ are crack free and 
1 J 2-* 3 4 5 6 7 8 9 10 11 

have no mold on them. Shake them to make sure that they are 
12 13 14 15 16 17 13 19 20 21 22 23 24 

heavy with water. Now hold o coconut in one hand over a sink 
25 26 27 28 29 3031 32 33 34 35 3637 

a brick 

and hit it around the center wilhflTTii | In i ml n> a lillll|||ii i 
38 39 40 41 42 43 44 45 46 47 484950 
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When buying 
1-* 2-* 3 



coconuts, make sure 3 are crack free and 
4- 5 6 7 8 9 10 11 



have na mold an them. 
12 13 14 15 16 



Shake them to make sure that they are 
17 18 19 20 21 22 23 24 



heavy with water. 
25 26 27 



Now hold a coconut in one hand over a sink 
23 29 3Q31 32 33 34 35 3537 



and hit it around the center with la brick 
38 39 40 41 42 43 44 4546 
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When buying] coconuts, make sure that they are crack free and 
I 3 ?=* 3 4 5 6 7 8 9 10 11 

have no mold on them. Shake them to make sure that they are 
12 13 14 15 16 17 18 19 20 21 22 23 24 



heavy with water. 
25 26 27 



Now hold a coconut in one hand over a sink 
28 29 3031 32 33 34 35 3637 



and hit it around the center with the claw end of a hammer. 
38 39 40 41 42 43 44 45 46 47 48 4950 



VERSION 
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When buying 
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COPY 2 1 
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POINTER 



FIG. 1D 



When buying coconuts, make sure that they are crack free and 
1 J 2-* 3 4 5 6 7 8 9 10 11 

have no mold on them. Shake them to make sure that they are 
12 13 14 15 16 17 18 19 20 21 22 23 24 

heavy with water. Now hold a coconut in one hand over a sink 
25 26 27 28 29 30 31 32 33 34 35 36 37 

and hit it around the center with the claw end of a hammer. 
38 39 40 41 42 43 44 45 46 47 48 49 50 
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When buying [coconuts, moke sure! that they are crack free and 
±* 2-* 3 4 5 6 7 a 9 10 11 



have no mold on them. 
12 13 14 15 16 



Shake them to make sure that they are 
17 18 19 20 21 22 23 24 



heavy with water. 
25 26 27 



Now hold a coconut in one hand over a sink 
28 29 30 31 32 33 34 . 35 36 37 



and hit it around the center with the claw end of a hammer. 
38 39 40 41 42 43 44 45 46 47 484950 
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When buying coconuts, make sure that they are crack free and 
1 J 2-* 3 4 5 6 7 8 9 10 11 
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Shake them to make sure that they are 
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heavy with water. 
25 26 27 



Now hold a coconut in one hand over a sink 
28 29 3031 32 33 34 35 3637 



and hit it around the center with the claw end of a hammer. 
38 39 40 41 42 43 44 45 46 47 4S4950 
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When buying coconuts, make sure that they 
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When buying coconuts, make sure that they are crack free and 
t> 2-* 3 4 5 6 7 8 9 TO TT 



have no mold on them. 
12 13 14 15 16 



Shake them to make sure that they are 
17 18 19 20 21 22 23 24 



heavy with water. Now hold a coconut in one hand over a sink 
25 26 27 28 29 3031 32 33 34 35 3637 

and hit it around the center with the claw end of a hammer. 
38 39 40 41 42 43 44 45 46 47 48 49 50 
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TRANSFORMATION 



c 


A n k 

a a d 


C G 


a d c u e i 


c 


d x y 


x y 


x y x y b c 


1. 


COPY 


4 


0 


2. 


ADD 


2 


x.y 


3. 


COPY 


6 


20 


4. 


COPY 


5 


9 



1. n = length(VERSI0N1); 

2. C = 0 

3. while(tnie) 

4. { inst - reodinetQ; 

5. if(inst == end-of-file) 

6. return; 

7. s = neadsize(); 

8. if(inst == ADD) 

9. readdota(VERSION2+c,s); 

10. else 

11. { p = reodpos(); 

12. if(p < n) 

13. copy(VERSI0N2+c,VERSI0N1+p,s); 

14. else CQpy(VERSlON2+c,VERSION2+p-n,s); 

15. i 

16. c » c + s; 

17. | 

FIG. 3 
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1. Initialize table of positions T to empty; 

2. process(VERSIONI); 

3. processCVERSiONZ); 

4. process(seq) 



5. { n * length(VERSIONt); 

6. m = length(seq); 

7. c = 0; 

8. add = -1; 

9. pos = -1; 

10. len = MlN-1; 

11. whileO) 

12. { while(1) 

13. | p = search(T,seq,c,len); 

14. if(p < 0) 
13. break; 

16. len = extend(T,seq,c,p,len); 

17. pos = p; 

18. \ 

19. if (pos < 0) 

20. j if(add < 0) 

21. add = c; 

22. if(seq «■ VERSION 1) 

23. insertfT,seq f c»Q); 

24. dse insert(T,seq,cy»); 

25. c = c + 1; 

26. ( 

27. else 

28. | if (seq == VERSI0N2) 

29. writeinst(add,c,pos,len); 

30. p * c+len-(MIN-1); 

31. whtte(p < c+len) 

32. { \f(seq =« VERSKJNT) 

33. insert(T,seq,p,0); 

34. else insert(T,seq,p.n); 

35. p = p+1 

36. | 

37. c » c + len; 

38. add = -1; pos = -1; len = MIN-f; 

39. | 

40. if(c >= m-MfN) 

41 . break; 

42. } 

43. if(seq == VERSI0N2 and add >= 0) 

44. writeinst(add,m,- 1 ,0); 

45. } 



FIG. 5 
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1 . insert(T,seq,p,orig) 

2. | key = seq[p,p+1 p+MIN-1]; 

3. pos = p+orig; 

4. Insert (key.pos) into T; 

5. I 



FIG. 6 



1. search(T,seq,c,len) 

2. | n - length(VERSI0N1); 

3. p = c -Men - (fcflN-1); 

4. key = seq{p,p+1,...,p+MIN-1]; 

5. for(each entry e in T that matches key) 

6. { pos ~ position(e); 

7. if(p >= n) 

8. | str = VERSI0N2; 

9. q = pos-n; 
10. | 

11. 



12. | str » VERS1QN1; 

13. q » DOS 
T4. \ 

15. d = q - (len - (MIN-1) ); 

16. if(d >=» 0) 

17. if(seq[c,c+1,...,p-ll == str[d,d+1,...,q-1]) 

18. return pos - (leu - (MJN-T) ); 

19. } 

20. return -1; 

21. I 



FIG. 7 
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1. extend(T,seq,c,p,len) 

2. { n » lenqth(VERSI0N1); 

3. if(p < n) 

4. str = VERSION!; 

5. else 

6. | str = VERSI0N2; 

7. p = p-n; 
8- } 

9. m = length(seq); i = c + len + t; 

10. n = lenoXstr); j - p + len + t; 

11. whilefl < m and j < n) 

12. if(seq[i] != seq[j]) 

13. break; 

14. return i-c; 

15. \ 



FIG. 8 
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